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ABSTRACT 

Reported are findings from the first year’s field 
test of the home-oriented Appalachia Educational laboratory (AEI) 
Early Childhood Education Program for 3-, 4-, and 5-year-olds. The 
program consists of a 30-minute daily television lesson, a weekly 
home visit by a paraprofessional, and group instruction once a week 
in a mobile classroom. The sample vas made up of a total of 450 
children divided into three groups. Group 1 received TV instruction 
and home visits and attended the mobile classroom. Group 2 had TV and 
home visits; Group 3, only TV instruction. 30 subjects from each 
group mere tested for evaluation purposes. The data are presented in 
5 categories: program effort, program performance, program 
pervasiveness, program cost analysis, and evaluation synthesis. 
Appendixes (one-sixth of this report) present detailed data analysis 
for (1) the program’s evaluation plan, (2) interest level of project 
children, (3) IQ gain, (4) language development and behavior, (5) 
cognitive growth, (6) the parent attitude questionnaire and 
checklist, (7) paraprofessional attitude data instrument and results, 
and (8) socioeconomic factors of treatment and control groups. It vas 
found that TV lessons and home visitations (but not the mobile 
classroom) had a positive effect on children’s cognitive development. 
Children in Group 1 scored highest on verbal expression. (DR) 
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Foreword 



This evaluation report is ;frltten primarily for Individuals in 
management positions. Accordingly, the report is Organized around the 
questions that guided the evaluation, followed by concluding statements 
obtained from more detailed data analyses. Individuals interested in 
the detailed analyses will find them located in the appendices. 

This report supersedes a preliminary report written by H. Kent 
Moore dated September, 1969. A number of Individuals have provided in- 
valuable inputs to the report, but special recognition should be given!, 
to Dr. Ray Morris from George Peabody College, Dr. FreuiJc Hooper frc^ 

West Virginia University, and Dr. John Kennedy from The Ohio State uni- 
versity for their assist£tnce in the data analyses. Dr. Benjamin Carmichael 

and Dr. william Boat from the Appalachia Educational Laboratory contrib- 

* 

uted significantly to the fin2d editing. 

This is the first report based on an evaluation system designed 
especially for educational development at the Appalachia Education2d 
Laboratory. This system incorporates sOTie of the concepts of the CIPP 
model developed by Dr. Daniel Stufflebeam at The Ohio State University 
and some of those developed by Dr. Michael Scriven at Indiana University. 



James T. Ranson 



EVALUATION ItEPORT: EARLY CHILDHOOD EDUCATION PROGRAM 

1969 FIELD TEST 

Introduction 

This is a technical report of the findings from the first year's field 
test of the AEL Early Childhood Education Progreun. An evaluation plan (see 
Appendix A} specifies the questions that were asked to secure the ^pe of in~ 
formation that was considered important. This report follows the organization 
of the questions as they are listed in Section I, B, of the plan. 

The Program 

The Early Childhood Education Program is home-oriented and is* designed 
for 3-, 4-, and 5-year-old children. It consists of a 30-minute daily tele- 
vision lesson received in the home; a weekly home visit by paraprofessionals 
to counsel with parents and deliver materials used by parents and children, 
and group instruction provided once each we^ in a mobile classro<xn taken near 
the home for convenience to parents and small children. 

The program is based on b^avioral objectives developed by West Virginia 
University derived f3Com a nationwide study of preschool education programs and 
an assessment of 3-, 4-, and 5-year-old Appalachian children. A materials 
development team is employed to translate those objectives into television 
lessons, materials for use by parents and children, and materials £uid exer- 
cises for use in group instruction in the mobile classroom. 

The lessons, recorded on video tape, are produced in Charleston, West 
Virginia, using the facilities of a commercial studio. They are sent to Oak 
Hill, West Virginia, where they are broadcast by a conmercial television sta- 
tion over an eight-county area of southern West Virginia. The hcmie visitation 
and mobile classroom components of the program operate out of Beckley, West 
Virginia. Eight paraprofessionals were employed and trained to perform home 
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visitation services# and one certified preschool teacher and an aide wcire em- 
ployed to operate and furnish mobile classroom instruction. The fully equipped 
8* X 22* classrocan is mounted on a two and one-half ton truck chassis. Power 
for the operation of the heating and cooling syston and all electronic equip- 
ment in the classroom is provided through meters mounted on poles at each 
scheduled stop of the classroom. The mobile classrocan was used for only four 
months of the 1969 field test. An office is maintained in Beckley as head- 
quarters for the field personnels 

The Sample 

A total of 450 children was selected from the viewing area as the target 
audience for the program. This sample was categorized into three groups. The 
first group of 150 children — 'ten subgroups of 15 each — received TV instruction# 
home visits# and attended the mobile classroom. The second group of 150 re- 
ceived TV instruction and home visits# and the third group of 150 received only 
TV instruction. 

For evaluation purposes# 30 individuals per gTOup for a total of 90 sub- 
jects were selected for testing purposes# and an additional 24 subjects in 
southwest Virginia were selected for a control group. 

Nature of the Data 

The data for this report were collected in the first year of a scheduled 
three- year field test of the Appalachia Educational Laboratory Early Childhood 
Education Program. The field test period closely approximates a regular school 
year# September through May. 

There was wide variability in the availability and quality of data for 
each item. Responses to each question were interpreted accordingly. The 
availability and quality of data were categorized as follows: 
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• Data not available or determinable. 

• Data available but not collected. 

• Data collected but not sufficient for conclusive answer. 

• Data collected sufficient for a conclusive answer. 

Responses to each question were keyed by one of these four categories. 

It was assumed that questions where data were not available or determinable 
at this time were not answer^le and therefore must be abandoned or delayed. 

Data were not gathered on question^, where data were available but not 
collected for reasons of (1) program lags# (2) time pressures r (3) political 
considerations f (4) practical considerations # or (5) low priority status of an 
item in the evaluation during the first year. 

On questions where insufficient data were available for ;a firm answer , 
more extensive data gathering during the second and third years of field test- 
ing should yield sufficient data for a conclusive answer. 

On questions for which there is sufficient data available and collected 
to provide a conclusive answer » it is not anticipated that further data collec- 
tion will be necessary. 

Data are presented by five major categories: program effort, program 

performance, program pervasiveness, program cost analysis, and evaluation 
synthesis. Detailed data analyses are included in the appendices. 

Program Effort 

Program effort is defined theoretically as time, personnel, and money 
required to acquire, .install, operate, and maintain the field test. Effort is 
expressed operationally in terms of days and dollars* Theoretical definitions 
provide the criteria for the questions; operational definitions represent the 
measurements for answers to the questions. Program effort was categorized by 
three major functions: (1) acquisition and insto^at4.on of facilities anc| 
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equipment, (2) operational requirements for the field test, and (3) equipamt 
and facility maintenance requirements. Questions included in the evaluation 
plan were grouped according to these categories. 

Acquisition a nd Installation of Equipment and F aeilit-iPc 

Six questions in the evaluation plan deal with the acquisition and in- 
stallation of equipment and facilities. Infornnation pertaining to this category 
of effort is presented in Table I, page 5. As indicated in the Table, most 
equipment required for the television component of the program was ranted. 

Studio time and office apace for the materials team was available in a 

cial studio in Charleston, West Virginia, certain technical personnel were 
also included in the studio package, office space for the field operation for 

mobile classroom personnel and home visitors was available in Beckley, West 
Virginia. 

Parking spaces for the mobile classroom were secured from churches, 
schools, and community centers. Power companies installed ten 220-volt meters 
for operation of the mobile classroom. The coordinator of the field testing 
operations made arrangements for these facilities. Experience indicated that 
at least one year of lead time is needed for making these arrangements and pre- 
paring for the production of the television lessons, no major legal obstacles 
were encountered to prevent the installation of the field testing operation. 

Special consultants were used in connection with acquisition and in- 
stallation of some equipment, some services were required to establish speci- 
fications for media requirements, and extensive services were required to 
develop specifications for the mobile classroom facility. 

Operational Requirements 

seven questions in the evaluation plan were directed toward determining 
program effort expended to meet operational requirements. 




Those requirements 
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Table I 

Acquisition and Installation of Equipment and Facilities 



Program Cos^nent 



Equipment and Facilities 



Method of Acquisition 



Television Studio package: Two black and white Rental 

cameras, lighting, film chain and 
requisite components for control 
room, sound and taping. 

Darkroom Rental 

Four 16 mm cameras Purchased 



Office and workroom space 
Transmitting station 



Rental 

Rental 



Home Visitation Field Office 

Automobiles 



Rented 

Personal cars 



Mobile Classroom Preschool classrocmt, 8* x 22*, mounted Purchased 

on. two and one-half ton International 
truck chassis. Classroom Includes 
electric heating and ^r conditioning, 
carpeted floors, six listening sta- 
tions, record player, 16 mm projector, 
overhead projector, projection screen, 
psychedelic lights, hot. plate stove, 
refrigerator, restroom facilities, 
and storage cabinets. 

Ten power supply meters Contracted 

Parking locations Donated 



Field Office 



Rented 
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deal with personnel requirements and time expended by them, requirements from 
other participating agencies, personnel training requirements, and efforts 
expended tc determine the consistency between TV lessons and other materials 
and the priorities assigned to the behavioral objectives established for the 
program. Data recorded on operational requirements are presented in Table II, 
page 7. 

Six professional positions, a supporting production position, and one 
secretary were maintained for the production of TV lessons. Two professional 
positions, one to coordinate mobile classroom and home visitations and a 
mobile classroom teacher, were maintained to <x>nduct the field testing activi- 
ties. One peuraprofessional served as a teacher aide in the m^ile classroom, 
and eight paraprofessionals were used for h<mie visitors. Time expended by 
all personnel and cooperating agencies participating in the field testing 
activities are shown in Table II. 

Cooperating agencies furnished vital services for installing and con- 
ducting the field test. I«ocal power companies installed power outlets. The 
West Virginia State Department of Education -furnished funds to provide snacks 
for children in the mobile classroom. Local employment agencies assisted in 
recruiting and interviewing paraprofessionals. Local school systen^ assisted 
in identifying groups of students, and one school system furnished the m^ile 
classroom teacher through contract to the Laboratory. 

In addition to program personnel as reflected in Table II, one full- 
time coordinator of the program and a one-half time secretary was maintained 
in the central staff of the Laboratory. Those positions have been maintained 
throughout the development of the Early Childhood Education Program and devote 
time to all three program components. 

Additional program effort eiqpended in operation Included the provision 
of three weeks of inservice training for peuraprofessionals prior to the 
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Table II 

Program Effort Expressed in Terms of Operational Requirements 



Program Cwoponent 



Classification 



Requirements 



Television 



Personnel 



Professional Time 
Production Assistance 
Clerical Time 
Consultant Time 

Cooperating Agencies 



Curriculum Materials 
Coordinator 
Program Manager 
On-Camera Teacher 
Two Research Teachers 
Artist-Photographer 
Production Assistant 
Secretary Consultants 

11,520 man hours 
1,920 man hours 
1,920 man hours 
120 man hours 

Television Station 
TV Production Studio 



Home Visitation 



Personnel Field Activity Coordinator* 

Eight Paraprofesslonals 
Secretary* 

Consultants 



Professional Time 
Paraprofesslonal Time 
Clerical Time 
Consultant Time 



960 man hours 
12,800 man hours 
960 man hours 
136 man hours 



Cooperating Agencies Local Bnployment Agency 

Local School Systems 



Mobile Classroom 



Personnel 



Field Activity Coordinator* 
Mobile Classroom Teacher 
Mobile Classroom Aide 
Secretary* 



Professional Time 
Paraprofesslonal Time 
Clerical Time 



2,880 man hours 
1,600 man hours 
960 man hours 



Cooperating Agencies 



Power Companies 
State Department of Education 
Local Enployment Agency 
Local School Systems 




*Tlme divided one-half between Mobile Classrocmi and Home visitation 



initiation of field activities. Two weeks were devoted to an introduction of 
curriculum materials and the third we^ to sensitivity training and interview 
techniques. One afternoon per week during the entire year was spent by members 
of the curriculum materials team with the heme visitors as mutual inservice 
training for both groups. All time used for inservice tr2u.ning is accounted 
for in Table II. 

Question 5 in the evaluation plan dealt with operational costs. These 
are omitted here but are presented in the Cost Analysis section of this report. 

A final note on operational requirements; Although no systematic data 
were collected and analyzed on the subject, specific feedback devices did exist 
to achieve congruency of b^avioral objectives, television lessons, and sup- 
porting instructional i,^terials during the first year field test. Obviously, 
too, such monitoring techniques were valuable inputs in the process of assign- 
ing priorities to various objectives. A cosoplete description of this monitor- 
ing-feedback activity is presented in Appalachia Pre-school Program ; A 
Process , First Year Report . 

Maintenance 

Questions tfere included in the evaluation plan aimed at determining 
the effort required to maintain the equipment and facilities required for oper- 
ation of the program. Equipment associated with the TV lesson production was 
maintained as a part of the lease with the TV studio where programs were pro- 
duced and the station idiere the programs were transmitted. Minor equipment 
such as movie cameras were maintained by the curriculum materials team 
photographer . 

Mobile classroom facility maintenance wais covered by an agreement with 
the local dealer from tdiich the equipment was purchased; terms specified that 
the equipment be made available to the dealer one afternoon per week for the 
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purpose of routine maintenance checks and repair as needed; the dealer also 
provided an on-call emergency service in case of breakdovms. (In the West 
Virginia program this was a Gu^;rdian Maintenance Agreement through Raleigh 
Motors# the local International dealer.) Maintenance of the media equip- 

e 

ment and other specialized equipment in the mobile classroom were the 
responsibility of the teacher. 

From one year's operation in west Virginia# $40 per week for 40 weeks 
was estimated for covering repair# routine maintenance# and gasoline costs. 
Insurance and license fees amounted to an additional $900. This $2 #500 is 
the total estimated annual operating cost for the mobile classroom. 

Wo criteria were defined for establishing a firm amortization table 
for the major equipment items. A very conservative five-year estimated amor- 
tization schedule is used in a subsequent section of this report. 

Program Performance 

Program performance was defined theoretically as learning which occurred 

in the target population — 3-# 4-# and 5-year-old children — as a result of the 

* 

AEL Early Childhood Education Program. Learning was categorized according to 
language# cognition# psychomotor# orienting and attending# and affective. The 
first four categories were used for conceptualizing the behavioral objectives 
for the program.^ The affective category was added after initiation of the 
field test. For the year's field test# learning in the language and cogni- 
tive areas was studied. 

Language was defined operationally as responses to the Illinois Test of 
rsycholinguistic Abilities (ITPA) and responses to silent movies designed to 
encourage language production. Cognition was defined operationally as responses 

%rank H. Hooper and William H. Marshall# The Initial Phase of a pre- 
school Curriculum Development Project . (Charleston: App>alachia Educational 

Laboratory# Research and Information Center# 1968) # pp. 97-197. 
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to the Peabody Picture Vocabulary Test (PPVT) and responses to the Appalachian 
Preschool Test of Cognitive Skills , a picture test similar in format to the 
PPVT and the ITPA. Intelligence was included in the category of cognition. 
Interest was defined operationally as responses to an attitude checklist 
developed by AEL staff and responses reflected in anecdotal records taken dur- 
ing the year. 

Since the early childhood program was home-oriented# the parents were 
considered a secondary target population. Learning on the part of parents 
was categorized according to interest# attitude# and motivation. Interest and 
attitudes were defined operationally as responses on individual items in an 
attitude checklist and a parent attitude questionnaire developed by the T^L 
evaluation staff. Motivation was defined theoretically as sustained level of 
attitude and/or interest and operationally as the average response to all 
items on the attitride checklist. 

Additional data were collected aimed at measuring progreun performance 
in terms of the general attitude and role acceptance of the mobile classroom 
teacher and paraprofessionads. Attitude was defined operationally as responses 
recorded during an interview schedule and theoretically as readiness to re- 
spond (mental set) at the time they were confronted with the instruments. 

The program performance inquiry was guided by eight questions on stu- 
dent performance# six questions on parental performance# five questions on 
paraprofessional performance# and four questions on mobile classroom teacher 
performance. 

Student Performance 

Interest level . The interest level of children st6u:ted high and re- 
mained reasonably high for the duration of the first year. There was a slight 
decline# however# from the beginning to the end of the year. The mean attitudinal 
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response was 0.74, on a scale of 0.00-1.00, at the beginning of the. year euid 
0.53 at the end, a mean difference of 0.21. A detailed analysis of interest 
level is contained in Appendix B; however, only partial data were available 
for this analysis. 

A separate question in the evaluation plan sought to determine student 
interest in the television lessons only. Data were taken from the anecdotal 
records of home visitors, based on the 300 children in the total package group 
and the TV and home visitation group. Measurements were based on a ratio of 
positive to negative comments pertaining solely to the television lesson on 
a week-to-week basis. The interest remained relatively constant for the year. 

On a scale of 0.00-8.00, the ^sitive to negative ratio ranged from 
1.21 for 3-year-olds to 1.89 for 4-year-olds to 2.17 for 5-year-olds. See 
Figure 1 of Appendix B for the detailed euialysis. 

Intelligence level . Intelligence was defined theoretically as the ex- 
tent to vrtiich children could correctly recognize pictures euid was defined 
operationally as responses to the Peabody Picture Vocabulary Test . It was 
assumed that verbal ability was directly euid positively correlated with intel- 
ligence. The general intelligence level of 3-, 4-, and 5-year-old children 
did increase significantly. However, the data did not support cuiy contention 
that the ECE program contributed to the increase in general intelligence. 

There was a gain of approximately 8.4 IQ units among all treatment groups in 
the six-month period. Of the four treatment groups, the group that ordinarily 
would have been expected to gain least because of no exposure actually gained 
the most. A detailed analysis is included in Appendix Ci however, only partial 
data were available for this analysis. 
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Growth in leuiguage develofanent of 3-, 4 ~, and 5-year-old children . A 
qualified yes can be given to the question on growth in leuiguage development. 
Pre*cUid post-test using the Illinois Test of Psycholinguist ic Abilities was 
used to measure the operational gain in language development. The pretest, 
however, was administered 60 days after the beginning of the field test. 

The ITPA consists of the following 12 subtests: 

1. Auditory reception 

2. Visual reception 

3. Auditory/vocal association 

4. Visual/motor association 

5. Verbal expression (vocal encoding} 

6. Mcuiual expression (motor encoding) 

7. Gramma tic closure 

8. Supplementary test 1 — auditory closure 

9. Supplementary test 2 — sound blending 

10. Visual closure 

11. Auditory sequential memory 

12. Visual sequential memory 

Supplementary test 1, auditory closure, euid supplementary test 2, sound 
blending, were not used for this study. 

Only Subtest 5, verbal expression, was directly related to the b^ayioral 
objectives sought during the year. The objectives were: 

1. To identify and describe cui object in terms of its physical 
characteristics . 

2. To identify and describe cui abject in tesnns of its function. 

3. To identify and describe an object in terms of its location. 
Instruction aimed at these objectives was given during the last two months of 
the year. 

Subtest 5 measures the child's ability to express his own concepts ver- 
bally. According to the authors, ih will: 

Assess the ability of the child to express his own concepts vocally. 

The child is shown fodr familiar objects one at a time (a ball, a 
block, an envelope", euid a button) and is asked, "Tell me all about 
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this-" The score is the mamber of discrete/ relevant/ and approxi- 
mately factual concepts expressed.^ 

Data presented in Table III indicate that children receiving all three 
program components scored significantly higher than the two other treatment 
groups and the control group. 



Table III 

Gains in Verbad Expression 



Groups Units Gain 

Television/ Home Visits/ and 

Mobile Classroom 4.37 

Television and Home Visits 0.05 

Television 1.41 

Control 1 . 63 



Gains reflected on other subtests were erratic/ probably because they 
were not directly related to language objectives used in the first year. A 
detailed report is included in Appendix d- The data were insufficient for a 
comprehensive anadysis. 

Language development in 5-year-old children . This study of language 
development was conducted under the auspices of Dr. William j. Griffin at the 
Institute on School Learning and Individual Differences at George Peabody 
College for Teachers in Nashville/ Tennessee. The AEL staff collected data 
on the 3-/ 4-/ and 5-year-old children in the target population/ and the com- 
parison was made with 5-year-old children in a Tennessee kindergarten. The 
following conclusions were reported: 

2 . .... 

Samuel A. Kirk/ James J. McCarthy/ and Winifred D. Kirk/ Examiners 

Manuad Illinois Test of Psycholinguistic Abilities ( Urbana : The Board of 

Trustees of the University of Illinois/ 1968)/ p. 11. 



1 



14 



. language sample studied r^l^cted a lack of fluency 

in children who produced them. 

2. The 5-year-olds in the AEL sample generally e^^loited the 
syntactic resource of the language as proficiently as did 
the conventional kindergarten children. 

This evaluation report, including the purpose of the study, the sam- 
ling analysis, an explanation of the analysis, processing and reporting of 
the data, interpretation, and conclusions, is included in Appendix E. Again, 
only partial data were available for this analysis. 

Cognitive growth . Cognition was defined theoretically as the ability 
of a child to recognize numbers and symbols correctly and to make associations. 
Operationally it is defined as responses to a 95-item test developed specifi- 
cally for the AEL program curriculum. Of the 95 items, children receiving TV, 
mobile classrotxn instruction, and home visitation and the group receiving TV 
and home visits responded correctly to 45 per cent of the items; whereas, the 
other two groups responded correctly to only 33 per cent. This difference repre- 
sented an estimated 36 per cent gain in cognitive behavior. However, there was 
no significant difference between the TV, home visitor, and classroom group and 
the TV and home visitor group; but there was a significant difference in the TV 
(only) group over the control group. See Appendix F for the detailed analysis. 

General . Two other attempts were made to assess general program per- 
formance. An effort was made to determine the separate and interdependent 
effects on language development and cognition of television instruction, home 
visitation, and mobile classroom instruction. Only partial data were avail- 
able. Also, a study was made of the process of reporting pupil reactions and 
incorporating them in subsequent program activities* 

Several factors contributed to the difficulty of assessing the compo- 
nent influences on language and cognitive development. The mobile classroom 
was used for only the last four months and its basic function was to 
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strengthen orienting and attending skills. a1:iei‘e is some suggestion that TV 
viewing and mobile classroom attendance were negatively interactive. For ex- 
ampler it is possible that parents of the children in the mobile classroom 
treatment group took less in-home interest in their children on the assump- 
tion that the mobile classroom experience was instructionally ade^ate. Con- 
versely r it is possible that parents of children in the television-plus-home 
visit treatment group increased their levels of involvement because there was 
no concern about doing something that would not be pleasing to the teacher. 

An equally plausible e3q>lanation is that parents increased their involyement 
levels in an unconscious or intentional effort to compensate for the missing 
mobile classroom e3q>erience in the lives of their children. 

The data did indicate^ however^ that the 30minute daily television did 
have a true effect on cognitive behavior and that the weekly half-hour home 
visit had an additional effect. No additive effect was produced on cognitive 
behavior by the mobile classroom r but a significant effect was discerned in 
growth in verbal expression with the addition of the mobile classroom. 

Relative to feedback from home visitors on pupil reactions r a weekly 
report was sulxnitted on each child. These reports were studied in program 
planning sessions twice per week. Program adjustments were made as quickly 
as possible. For example r evidence in November of 1968 indicated that the 
interest of 5-year-olds was lagging r apparently because programs were geared 
more toward 3- and 4-year-olds. A successful adjustment was made by December. 
E}q)erience indicated that it took approximately one month to incorporate cor- 
rective feedback into program production. 

Parent Performance 

Program performance based on parent participation in the program was 
measured in terms of general parent iii teres t and cooperation r parent motivation 


















as determined by attitude toward several aspects of the program, and parent 
assessment of their children's behavior resulting from participation in the 

program, it was considered, however, that only partial data were available 
for tl.a assessment of any of these results. 



Parent interest . General parent interest was based on a week-to-week 
assessment of attitude toward the "home visit" and attitude toward the "ECE 
program." Parent interest virtually paralleled the interest registered for 
the children, it is acknowledged that the home visitor "filtered" these re- 
sponses of parents just as parents undoubtedly filtered children's reactionsi.,.. 
The detailed analysis is contained in Appendix B. 

Parent motivation. The level of parent motivation was recorded in 
terms of the year-long average, attitudes toward separate components of the 
program, and the variation in attitude in accordance with the addition of 
components. The operational definition of motivation level was the combined 
average for all nine items on the attitude checklist scale pertaining to par- 
ents as recorded by the home visitors. A fairly stable year-long average of 
0.76 on a scale of O.OC 2.00 was recorded. 

The assessment of parent attitude toward the home visitation and mobile 
classroom components is shown in Table iv, page 17. 

Home visitors rated parental attitude toward television lessons o.74 on 
a 0.00-1.00 scale. Table V, page 17, shows the percentages of children and 
parents who watched TV lessons four and five days per week by treatment groups. 

Data in Table V indicate that parent interest in TV lessons was defi- 

V 

nitely stimulated by the activity of the home visitor. The mobile classroom, 
however, appeared to have no effect on television lesson interest. 

A further attempt was made to determine general parent motivational 
level in relation to program components. Inferences were drawn from parent 
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Table IV 

Parent Attitude Home visitation cuid Mobile Classroom Components 

of the Early Childhood Education Program 



Source ctnd Type of Data 



Program Comix>nent 
Hone Visitation 



M^ile Classroom 



Parent response ; 
visit hcsM once a 
effective. 

Parent response ; 
heme visitor were 
or "very good." 

Parent response ; 
plained materials 
"very good." 



home visitor should 
week to be most 



materials left by 
either "excellent" 



hcmie visitor ex- 
" excel lent" or 



Per Cent Response 
96 

89 

89 

80 

96 

70 



Home visitor ; positive attitude of 
parents toward materials. 

Parent response ; child talks about 
things done in mobile classroom. 

Parent response * parent had opportun- 
ity to visit mobile classroom. 



Table V 

Percentages of Children euid Parents Vfho Watched Television Lessons 
Four cuid Five Days Per Week by Treatment Groups 



Treatment (hroup 



Per Cent Watching 

Days Per week Parents Children 



TV, H<xne Visits 

and Mobile Classroom 



5 

4 



23 41 

41 42 



Television and 
Home Visitation 



5 

4 



27 47 

29 35 



5 10 20 

4 17 24 



Television 
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responses on the attitude questionnaire completed by parents. A significeuitly 
higher percentage of parents participating in the program inhere all three com- 
ponents were used gave positive responses to most of the questions pertaining 
to behavioral change in the child or in total feunily than the parents whose 
children received only television instruction. The second highest response 
came from the group receiving television instruction and home visitation. 

In summary, the highest positive influence on parents seemed to come 
from home visitations. Howeverr it must be recognized that a degree of empathy 
developed between parents and home visitors that could have influenced parent 
responses to items in the questionnaire. Also, as indicated in Appendix G, 
those factors tdiich are mora conducive to desired behavioral changes (residence 
owned or rented, schooling of parents# etc.} were more prevalent in the group 
receiving all three components of the program than in the group receiving only 
two. 

Parent assessment of children* s behavior . A decided majority of parents 
indicated that they had observed a difference in the behavior of their children 
since enrolling in the program. Responses to six subquestions contained in 
Appendix H are shown in Table VI. 



Table VI 



Parent Observations of Changes in Children's Behavior 



Behavior Observed by Parents. 



Per Cent of Parents 
Responding Yes 



Plays better with other children 



82 



Expresses himself better 



89 



More aware of things around him 



89 



More able to do things for himself 



90 



Less shy around adults 



83 



More able to follow instructions 



91 
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Performance of Home Visitors 

Performance of hcmie visitors was defined theoretically as the role 
they played in the program and the attitude they held concerning their role. 
Responses to a Hcnne Visitor Questionnaire and a Heme Visitor Survey were used 
as the operational definitions of their role wd attitude. Questions dealt 
with relationships with parents and children, feelings about their vitail peurt 
in the program, their relationships with other program components and compo- 
nent personnel, and their personal criticisms of the program. Sufficient data 
to reach conclusive answers were available only on hone visitor's feeling 
about their vital role in the program. 

Responses of home visitors indicated that they spent a sli^tly greater 
amount of time with parents than with children. See questions II and IV of 
HVQ in Appendix I. 

Home visitors, as reflected by the tabulation in Appendix X, definitely 
feel that they perform a vital role in the operation of the program. 

Only inferences are possible relative to the relationship of hcxne visi- 
tors to other program personnel. Responses to Question III, Appendix i, were 
positive relative to m^ile classroom personnel. One hcaae visitor eaqpressed 
some negative attitudes toward TV lesson production methods, and one decidedly 
hostile remark was made in response to Question 7 of the Home Visitor 
Questionnaire . 

Questions 2, 3, 4, 5, and 7 of the Home Visitors Survey provided oppor- 
tunity to appraise the et^ucational program. Prominent criticisms, with num- 
bers of home visitors shown in parentheses, were as follows: 

1. Too much testing (4). 

. The feedback questionnaire (7) . Some requested that it be 
simplified, some that it be eliminated altogether, and some 
that less writing be required. 
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3. We^ly trips required for meeting in central (Becicley, 

W. Va.) office (4). Three wished for a mec':ing every 
two weeks, and one asked for monthly meetincjS. 

4. Too many review TV programs (3) • 

5. Travel problans on winter roads (3)* 

6. Home visitor training (4) . The three-week preliminary 
tr2d.ning session was disliked. Seven of the eight indi- 
cated that subsequent training programs consist of 
traveling in the field with an experienced home visitor. 



Mobile Classroom Teacher Performance 



No data were collected for the four questions on this phase of the eval- 
uation plan. 



Program Performance Pervasiveness 

Program performance pervasiveness is defined theoretically as the base 
for diffusing the Early Childhood Education Program. Program: peirormance per- 
vasiveness is defined operationally as the number and type of Individuals 
that can be affected by operation of the program. 

'Hie pervasiveness of a program under development, especially a program 
such as the AEL Early Childhood Education Program, my be very differcn't than 
the program ^dien made operational. The AEL Eeurly Childhood Education Progr^i 
is designed to operate on a regional basis encomipas sing several school sys- 
tems. The television lessons broadcast from the Oak Hill station have been 

reaching homes over an eight-county area of southern West Virginia. For 

1 

development pm^poses, however, the mobile classroom and heme visitation com- 
ponents have been extended to the number of youngsters required to try the 
program and conduct sufficient evaluation of it — approximately 300 children 
for home visitation and 150 for mobile classroom instruction. To determine 
program pervasiveness, however, all three components must be adjusted to the 
most appropriate Interface. The program is considered to be a unified set of 



activities ccmprised of television Instruction, home visitation, and mobile 
classroom instruction, ^e program is not designed to operate in less than 
one region; and for optimum conditions for operation, it should be conducted 
in several regions simultaneously*-even on a state or multi*state basis. 

In this report program perfommnce pervasiveness will be predicated on 
the eight-count/ area in southern West Virginia in the Oak Hill television 
broadcast area. Data for the report have been collected on the numbers of 
preschool children and parents of preschool children in the area; the number 
of school systems and school personnel in the area; and the socioeconcmiic 
status of the pop ^^J.on in the area. 

Counties, School Systems, and School Personnel 

. eight counties falling within the Oak Hill television viewing area 

are: 



Field trial units are located in those counties marked with an asterisk. 

There is one public school district, coterminous with the county boun^ 
dary, operated in each county. According to the West Virginia 1967'*68 Edu* 
cation Directory, there were 374 administrators — superintendents, principals, 
and superviso3:s — employed in the eight school systems. There were 489 first- 
grade teachers employed in the area. 

Socioeconixnic Status of Population 

Eight criteria were used to rate the socioeconcxnic status of the eight- 
county area. Data were based on 1960 census informtion. Table VII, page 22, 
presents the data by each criterion, for the United States, West Virginia, and 
the eight-county eurea. 



Fayette* 

Balei^* 

Monroe 



Mercer* 

Wyoming 

McDowell 

Summers* 



Nicholas 
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Table VII 

Census Data for the United States# West Virginia# and 
an Eight*County Area of Southern West Virginia 

Eight' 



Census Criteria 


United States 


W. Va. 


County Area 


Population per square mile 


51 


77 


87 


Population change (1950-60) 


18% 


-7% 


-17% 


Urban population 


70% 


38% 


20% 


Adults age 25 and over completed 
high school 


41% 


31% 


23% 


White collar workers 


41% 


36% 


33% 


Manufacturing workers 


27% 


23% 


10% 


Median family ineexoe 


$5660 


$4572 


$3876 


Children emd Parents Served 









Based on the best census data available and first grade enrollments in 
the eight-county area# it is estimated that there are 50 #000 preschoisl chil- 
dren# age 0-6# of which approximately 25#000 are 3# 4# and 5 years of age. 
Based on a study group sample there were 0.84 families per child which if pro- 
jected to the eight-county area would suggest that approximately 21,470 fami- 
lies would be affected. In the san^le group# 91 per cent of the families 
had both parents in the home# suggesting that a total of 40 #578 parents poten- 
tially could be involved in the program. 

Program Cost Analysis 

Two useful cost analyses may be made with regard to the AEL Early 
Childhood Education Program. Expenditures for the field test of the program 
during the 1968-69 school year, of course, represent developmental costs and 
may or may not bear significant relationships to the costs of the program 
under operationad conditions. For purposes of this re^rt, therefore. 
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expenditures will be reported for tV.e 1968-69 field test of the program which 
are considered develoj^oental costs. These costs correspond to program effort 
reported in the fi^tr section. Then operational costs of the program will be 



projecte(i^seid on the performance pervasiveness of the program as discussed 
in the previous section. After these presentations and analyses, implications 
will be described for school system operation and support of the program 



Development Costs 

Development costs included in this report cover 1968-69 field test 
activities only as reported in the Program Effort section. An amount of 
approximately $68,600 expended for background research and the development of 
learning objectives prior to initiation of the field test are not included « 

No attempt is made to derive a per pupil cost based on expenditures for devel- 
opment i for, as previously explained: (1) television instruction was avail- 

able to approximately 25,000 youngsters even though only 450 of these young- 
stars were included in the field test; and (2) approximately 300 children 
were provided hone visits while only 150 would have been needed to serve the 
single treatment group receiving the three- component program. 

Expenditures were maint6dned separately for television instjruction, 
home visitation, and mobile classroom instruction. Amounts by program com- 
ponents were as follows: 

Television Component $150,680 

Home Visitation exponent $ 53,165 

Mobile Classroom Component $ 58,709 

Line item expenditures by program components are presented in Table VIII, 

page 24. 




Operational Costs 

Operational costs projected here are based upon expenditures during the 
first year of field testing but adjusted to progr^^n performance pervasiveness 
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Table VIII 



Developmental Costs of the Early Childhood Education Program 

During the 1968*69 Field Test 



Program Component 



Item of Program Effort 



Component Total 



Expenditures 



5 


Television Professional Personnel 


$76,420 




Production Assistance 


1,530 




Consultants 


1,500 




Secretarial 


6,090 


> 


Production Studio 


23,000 




Broadcast Station 


4,200 


1 


Equipment 


14,440 


1 


Supplies 


17,500 


\ 


Travel 


6,000 




C<Hnponent Total 




i 


Home Visitation Professional. Personnel 


$12,845 




Paraprofessionals 


27,000 




Consultants 


1,700 


* 

s 


Secretariad 


3,320 


Office Space 


2,300 


> 


Travel 


6,000 




Con^nent Total 






Mobile Classroom Professional Personnel 


$23,985 




Paraprofessional 


3,375 


- 


Secretaurial 


3,320 




Mobile Classro<xii 


20,329 


1 

f 


Power Connections 


1,500 




Classroom Operation and 




K 


Maintenance 


2,500 


1 


Power Supply 


400 


f 

1' 


Office Space 


2,300 


5 


Travel 


1,000 



$150,680 



$ 53,165 



i 



$ 58,709 
$262,554 



ERIC 



PROGRAM TOTAL 
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described in the preceding section. Operational costs are based upon service 
of the program to 25,000 three-, four^-, and five-^year-old children estimated 
for the eight: counties incorporating the field testing site. 

As indicated previously, television lesson broadcasts covered the total 
area; therefore, no significant increase in this component cost would be re- 
quired under operational conditions. Based, however, on the use of one mobile 
classroon unit— classroom, teacher, and aide — for each 150 children, 167 units 
would be required to serve the 25,000 pupil population. For the home visita- 
tion component, based upon four home visitors for each 150 pupils (group per 
mobile classroom unit) , a total of 668 paraprofessionals would be required 
to perform home visits to 25,000 youngsters in the area. Estimated expendi- 
tures based upon this application are presented in Table IX, page 26. 

It is important to recognize that data included in Table IX are based 
on a first-year field test only. The data can be refined considerably during 
the second £Uid third years of field testing. Some estimates can be reduced; 
others no doubt will be increased. At least two additional positions are 
needed in tne curriculum materials team, and much larger volumes of materials 
would be required for progreun operation serving 25,000 youngsters. In ^e 
category of equipment for TV lesson production, the developmental effort is 
being conducted using rental equipment primarily. If the program were made 
operational, especially on a large scale, it would be more economical to build, 
equip, and operate studio facilities. Also, it is recognized that if capital 
outlay expenditures were excluded from current operating e3q>enses, as is cus- 
tomary in expenditure classifications for public school operation, operating 
expenses as reflected in Table IX would be reduced. 



Calculations for expenditures for the mobile classrocan component were 
based upon 150 students per classroom unit. Experience indicates that a 
mobile classroom unit may be capable of serving up to 200 pupils. Under 
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Table IX 

Estimated Annual Costs for Operation of Early Childhood Education 
Program in Eight-County Area for 25,000 Children 



Program Con^nent 



Television 



Hone Visitation 



Mobile Classroom 



Basis for Estimate 



Per Pupil 

Total Cost Cost 



Equipment acquisition and instal- 
lation as shown in Table I, page 
5, and personnel and consultant 
time as shown in Table II, page 7, 



668 paraprofessionals and other 
personnel requir^nents as reflec- 
ted in Table II, page 7. Also 
field office facilities and travel 
for home visitation. 



167 mobile classrooms and equip- 
ment as shown in Table I, page 5; 
1,670 power connections; field 
office; and mobile classroom oper- 
ation and maintenance. 167 mobile 
classroom teachers and aides and 
other personnel time as reflected 
in Table II, page 7. 



TOTAL 



$137,628 



$5.50 



$2,740,565 $108.62 



$3,655,725 $146.23 



$6,533,918 $261.35 
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operating conditions the mobile classro<xn imit would move much shorter dis*- 
tances between stops, and in scane cases two and three groups of students might 
be served in one location. Service to more pupils per unit and reduced oper- 
ating and maintenance costs would reduce per pupil costs for the mobile 
classroom ccmiponent. Also, the unit cost of the mobile classroom can be re- 
duced considerably when purchased in quantity. 

The basis for calculating the number of hone visitors was four for each 
150 youngsters — the number served by one mobile classrocxn. Experience also 
indicates that four home visitors are capable of serving slightly more than 
this number. This would be more nearly true under operating conditions where 
families and groups were located more closely together, and obviously this 
would reduce the cost of travel for home visitors. 

Estimated Cost by School System 

Were the aEL Early Childhood Education Program made operational, costs 
of the program would fall on individual school systems. Although the program 
would necessarily be operated jointly by them, each county school system 
should be responsible for its per pupil support of the program. This is not 
to say that support of the program should be derived from county revenues 
they might be local, state, federal, or suiy source of funds or a combination 
of these, but the per pupil cost should be established on the eight-county 
basis with each school system participating according to its number of stu- 
dents. Based upon per pupil costs reflected in Table IX, page 26, the esti- 
mated annual cost of the program by county would be as shown in Table X, 
page 28. 



o 
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X 

Estimated Annual Cost of the AEL Early Childhood Education 
Progr^un by County School System 



Number of 3-, 4-, and 



hool System 


5-year-old Children 


Estimated Cost 


Fayette 


4,350 


$1,136,872 


Raleigh 


5,490 


1,434,811 


Monroe 


690 


180 , 331 


Nicholas 


1,860 


486,111 


Mercer 


4,560 


1,191,756 


Wyoming 


2,880 


752,688 


McDowell 


4,740 


1,238,800 


Summers 


990 


258,737 


TOTAL 


25,560 


$6,680,106 



o 
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Evaluation Synthesis 

Far overshadowing all other factors in the first-year evaluation of 
the AEL Early Childhood Education Program was the demonstrated contplexi^ of 
planning, designing, testing, monitoring, and modifying an alternative edu* 
cation program for young children. The establishment of formative evaluation 
procedures and instrumentalities consumed enormous resources, and yet this 
first*-generation effort was probcd>ly no more than a crude approximation of 
future procedures. The management expertise required to coordinate, super* 
vise, and direct the three- component program vigorously tested the institu- 
tional reservoir of managerial skills. Based upon the year's experience, it 
is highly probable that program evaluative and meuiagerial requirements will 
increase rather than diminish in the second and third year tests. The 
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availability of funds to meet these requirements will be crucial to the tot6d 
program development effort. 

The firstryear evaluation of this program was cast on four dimensions: 

1. Program Effort 

What types and quantities of resources were necessary to 
operate the program? 

2. Program Performance 

What was the program effect on the primary and secondary 
target population? 

3. Program Pervasiveness 

Who and how many individuals could be affected by a typical 
program built along the dimensions of the development model? 

4. Program Costs 

What are the probable operational costs of a typical pro- 
gram constructed along dimensions of tt» development model? 

The question of program performance is central to all other considera- 
tims. If a useful outcone cannot be reliably produced in specified target- 
groups# then effort# costs# and esqiortability are irrlevant. How well# then# 
did thte primary target groi;p — 3-# 4-# and 5-year-old children — achieve pro- 
gram objectives? In sisamarys 

• Ihe evidence suggested that the tel^ision lessons and 
home visitations had a true positive effect on the cogni- 
tive development of the children. Ihe data did not support 
a similar conclusion for the mobile classroom. 

• In language development (verbal eiq»ression) # children in the 
three- component program scored significantly higher than 
other treatment groups ard the control group. 

Other findings indirectly related to pupil achievmnent include: 

• C!hildren*s interest in the program was relatively high for 
the year with only a slight decline over the nine-month 
period. 

4 Older children tended to like the television lessons better 
than younger children. 
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« No claim can be made that the program improves intelli- 
gence measures of children. 

9 Parental interest in the program paralleled the children's 
interest. 

e Parental motivation was high and fairly stable thscoughout 
the year. 

• The hcmie visitors contributed significantly to the moti- 
vations of parents. 

Baseline program pervasiveness data would suggest that an operational 
program in southern West Virginia fleshed out along the dimensions of the cur- 
rent development model would affect eight school systems, 374 school adminis- 
trators, 489 first-grade teachers, 21,470 families, and 25,000 three-, four-, 
and five-year-old children. The effort required for such a program %#ould 
necessitate an annual outlay of $137,628 for adequate television hardware - 
personnel capability; $2,740,565 for 668 peuraprofessionals and other personnel 
required to perform home visitation services; and $3,655,725 for 167 equi^>ed 
mobile classrocMns, teachers and aides, and miscellaneous support services, 
ihe total annual cost would be $6,553,918 pr $261.35 per pi:^il. 

A caveat: All program effort, performance, pervasiveness, and cost 

data should be considered tentative until confirmed or rejected by the sche- 
duled second and third year field tests. The estimation of operational costs 
from development costs is particuleurly hazardous and may be subject to gross 
error correction with subsequent field testing. 

In sunnn 2 U 7 , first-year data suggest: 

a Children to learn specified behaviors, and this learning 
is cissociated with a systematic program. 

e The program costs 50 per cent less per year than educating 
a child in a conventional classroom. 
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Introduction 

The ' valuation strategy of the Appalachia Educational Lab- 
oratory includes formative evaluation, summative evaluation, 
and pay-off evaluation. There are three phases of formative 
evaluation, i.e., context, input, and process. The Early Child- 
hood Education program has passed through the context and input 
phases * The outcome of formative context evaluation was a 
decision that the need existed for an enriched educational en- 
vironment for Appalachian preschool children. The outcome of 
the formative input evaluation was a decision to use a combina- 
tion of television, paraprofessionals , a mobile classroom, and 
a specially developed curriculum to provide a home-oriented 
preschool program. Decision concerning the feasibility of the 
proposed preschool program will result from the formative process 
evaluation. The result of the summative evaluation will be a 
decision concerning the quality of the program and the effective- 
ness of the program. The Early Childhood Education plan is 
designed for formative and summative process evaluation. 

The Early Childhood Education program became operative 
September 1968 and is scheduled to terminate September 1971, 
spanning four contract years . Three major evaluation events are 
scheduled — September 1969/ September 1970, and September 1971. 

The Early Childhood Education evaluation is organized to support 
these three evaluation events. The first evaluation event. 
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September 1961/ will be a documentation of decisions and changes 
made during the first year's operation, and those changes judged 
to be necessary for the second year's operation. The second 
evaluation event, September 1970, will be a documentation of 
the revis' ons and modifications made during the first two years’ 
operations and those proposed for the third year’s operation. 

Finally, the third evaluation event will be a documentation of 
the results of three years’ evaluation activities (i.e., summative 
evaluation) . 

For contract year 1969 the Early Childhood evaluation 
activities are designed to (1) provide information concerning 
the program installation, operation and maintenance; (2) identify, 
develop and refine preschool children’s performance measures in 
the areas of language development and cognition for the second 
year’s evaluation; and, (3) collect base-line data for the 
summative evaluation. 

The evaluation design is organized according to role definition, 
data collection, data organization, data analysis, information 
recording, and managing the evaluation activities. 

I. EVALURTIOM ROLE FOR EARLY CHILDHOOD EDUCATION . The evaluation 
role is defined by the critical decision-makers, the critical 
decision situations, and the criteria utilized in making the 
decisions . 

A. Decision-Makers . There are three groups of AEL decision- 



makers — Program, Field, and Evaluation. They are: 
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1. Program - Mr. Roy Alford, Mr. Don Nelson, Dr. William 

Host. 

2. Field “ Mr. Roy Alford, Dr. Robert Childers. 

3. Evaluation - Dr. James Ranson, Dr. Robert Childers, 

Mr. Kee Chang. 

B. Decision Situations . There are five categories of decision 
situations to which the decision-makers will address them- 
selves: effort, performance, pervasiveness, efficiency, and 
a synthesis of the previous four categories. 

1. Program Effort . The program effort decision situation is 
characterized by assessing the installation, operation 
and maintenance in terms of time, cost, and personnel. 

The following questions will define the Early Childhood 
Education effort decision situation: 

a. Installation . Answers to questions relative to this 
area will help establish a basis for determining how 
much effort is required to prepare for operation. 

1) How many major pieces of equipment are required 
for each of the three components of the program? 

2) What is the cost of the equipment in terms of 
the program components and total program cost? 

3) What facilities are necessary for housing the 
Early Childhood Education program? 

4) What local school, church, or other community 
facilities are required and what modifications, 
if any, are needed? 

5) How much time is required for installing the 
program? 
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6) Who is responsible for providing installation 
personnel and what personnel are required? 

7) What, if any, are the legal requirements for 
installing the Early Childhood Education program? 

o. Operation . Answers to questions relative to this 
area will help establish a i^isis for deter:.'', ining the 
effort required for operating under field conditions 
in terms of personnel and financial requirements. 

1) How much field managerial effort is required? 

2) How many and what types of agencies are required 
for operation? 

3) How many field man-hours are required to operate 
the program? 

4) What preservice and inservice programs (with their 
respective intrinsic evaluations) are necessary 
for operation? 

5) How are costs associated with questions 1) through 
4) to be accounted for? 

6) Are the video tape recordings and other related 
materials consistent with the behavioral objectives? 

7) How are the priorities assigned to the behavioral 
objectives? 

c. Maintenance . Answers to questions relative to this 
area will help establish a basis for determining how 
much effort is required to maintain the program. 

1) What procedures have been worked out for maintaining 
the equipment? 
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2) What costs have been projected for maintaining 
the mobile classroom equipment? 

3) How will the equipment be amortized? 

2. ^ rogram Performance . Answers to questions in the pre- 
ceding section will provide a basis for evaluating the 
effort required to install, operate and maintain the 
program. This section presents a series of questions 
pertaining to the results of the effort. The performance 
questions are organized according to students, parents, 
paraprofessionals, and mobile classroom teacher, 
a. Student performance . For this contract year these 
questions will be restricted to language development 
and cognition areas. The social development and 
psychomotor areas will be assessed during contract 
year 1970. This schedule was adopted for the 
following reasons: 

First, the curriculum development team needed 
time to become acquainted with developing the video 
tape recordings for television broadcast and other 
ancillary materials. It was assumed that one year 
was sufficient time for most major revisions to be 
made. 

Second, the mobile classroom was not available 
for the first four months operation, thus the major 
thrust for teaching social development and psycho- 
motor skills was not a part of the program for 44% 
of the time for the first year. 




Third, resources for developing curriculum 
specific measures (or adapting existing measures) 
in the social and psychomotor domains were un- 
available in time for the first year*s evaluation. 

The program is based on behavioral objectives re- 
quiring curriculum specific measures. Experience 
was needed for assigning priorities to the behavioral 
objectives for which television broadcast and 
ancillary materials would be development. Accordingly, 
for contract year 1969, answers to the following 
questions will be sought: 

1) Can the interest level for 3, 4, and 5 year old 
children be maintained with essentially the same 
program? 

2) Does the general intelligence level of the 3, 4 
and 5 year old children increase significantly? 

3) What is the status of the language development of 
the 3, 4, and 5 year old children in the study? 

4) Is there any significant growth in language 
development for the first year's operation on the 
part of 3, 4, and 5 year old children? 

5) What is the extent of growth in the cognitive area 
during the first year's operation? 

6) Do the television programs instill and maintain 
interest of the students? 

V) How are pupil reactions incorporated into subsequent 
program development? 



8) To what extent does television, the para- 
professionals, and the mobile classroom 
contribute independently and in combination 
to language development and cognition in 3, 4 
and 5 year old children? (See Appendix U) 

b. Parent performance . Questions concerning children's 

parents will be confined to the affective area. 

1) Does the program maintain parents' interest? 

2) Do parents notice any difference in their 
children's behavior since enrolling in the 
program? 

3) What is the general attitude of parents toward 
the different components of the program? 

4) What is the motivational level of the parents? 

5) Does parent motivation appear to vary with the 
addition of the mobile classroom or the home 
visitor, or a combination of both? 

6) How do fathers and mothers compare in participation 
in the program? 

c. Paraprofessional performance . For this phase para- 

professionals will provide data relative to general 

attitude and acceptance of their roles. 

1) Do the home visitors relate more to the children's 
parents or to the children themselves when they 
visit the homes? 

2) What and how many major criticisms do the para- 
professionals have concerning the educational 
program? 
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3) Do the paraprofessionals feel that they are a 
vital part of the operation? 

4) How do the home visitors relate to the personnel 
in the other program components? 

d. Mobile classroom teacher performance . For this phase 
answers to questions concerning the general attitude 
and acceptance of the role in the program will be 
sought. 

1) Does the mobile classroom teacher involve the 
children's parents in the mobile classroom 
activities? 

2) What and how many major criticisms does the 
mobile classroom teacher have concerning the 
educational program? 

3) Does the mobile classroom teacher see herself as 
a vital part of the Early Childhood operation? 

4) How does the mobile classroom teacher relate to 
the personnel in the other program components? 

Progrcim performance pervasiveness . This decision situa- 
tion will be defined by questions concerning the maximum 
operation of the Early Childhood Education in field 
locations. This can be thought of as the total popula- 
tion which the program can potentially serve. Concern 
is directed toward the total number of persons the pro- 
gram can serve. The previous section concerned a sample 
from the populatic.i. 

a. How many 3, 4, and 5 year old children are there in 
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the area in which the program is operative? 

b. Kow many parents in the area in which the prograun 
is operative could be directly and/or indirectly 
involved? 

c. How many administrators, including principals and 
supervisors, are there in the area in which the 
program is operative? 

d. How many school systems are there in the area in 
which the prograun is operative? 

e. How many first grade teachers are there in the 
operating area? 

f. What is the total population of children under six 
years of age in the area in which the prograun is 
operative? 

g. What is socio-^iconomic status of population? 

4. Program efficiency . This decision situation will be 
defined by questions concerning the total cost of the 
program effort in relation to the total number of 
people involved in the area in which the prograni is 
operating. Efficiency, therefore, can be thought of 
as a ratio of the aunount of money or resources it takes 
to operate the program to the output or performance that 
the prograun achieves. 

a. What is the annual cost per pupil per year for 
operating the prograun? 

b. What is the annual cost per pupil for operating the 
television element of the prograun? 

c. What is the annual cost per pupil for operating the 
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home visit element? 

d. What is the annual cost per pupil for operating the 
traveling classroom element of the program? 

e. What is the annual cost per local school unit for 
operating and maintaining the program? 

5. Program synthesis . This decision situation is character- 
ized by organizing the information generated in the 
previous four categories for the purpose of making final 
decisions concerning the first year's operation of the 
program. The decision-makers, identified in an earlier 
section, will produce questions for this section upon 
analysis of responses to previously stated questions. 

The questions will pertain to modifications and revisions 
in the program required for operation during the 1969-70 
school year. 

C. Decision Criteria . This section will specify the criteria 
for each of the decision situations outlined in the previous 
section. The following criteria are directly related to 
and organized bv the questions as cited in Section IB. 

1. Effort . The three categories of criteria for the 
program effort are: 

a. Installation . Criteria concerning program installa- 
tion are: 

1) The ntunber of pieces of equipment required to 
operate the program. 

2) The cost the program equipment within each 
of the three components and the total cost. 

3) The amount of square feet required for offices. 
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work space and storage. 

4) The number of loccil school, church, or other 
community facilities utilii;ed and the cost of 
any necessary modifications. 

5) The period of time from the day on which each 
of the three progrcim components was delivered 
to the field site to the time in which it first 
began operation. 

6) The number of person (s) or agency (s) responsible 
for identifying, selecting, employing, and 
training personnel for the installation of the 
program. 

7) The number of laws pertaining to the legal opera- 
tion and the number pertaining to enabling 
legislation for the program. 

b. Operation . Operation criteria cure: 

1) The number of people involved in managing the 
program in the field, the amount of time they 
devote to managing the operation, and the cost 
of managing the operation. 

2) The number of agencies and the name of each 
agency required for operating the program. 

3) The number of man hours required to operate the 
program. 

4) There will be a separate document reporting on 
the consistency analysis (intrinsic evaluation) . 

5) The number of financial sources and the number 
of budgets . 

- -- . - -p ■ I 
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6) There will be a separate document reporting on 
the inservice training for the home visitors 
(intrinsic evaluation) . 

7) There will be a separate document in rank 
ordering of objectives. Criteria will be derived 
from these documents* 

c. Maintenance . Maintenance criteria are: 

1) A description of the procedures used in maintaining 
prograJn equipment including individuals responsible 
for such maintenance. 

2) The amount of money in dolleurs. 

3) A ratio of time projected for the equipment to be 
used and the cost in dollars it takes to purchase, 
maintain and operate the equipment. 

2. Program performance . Program performance criteria are: 
a. Student performance . Student performance criteria 

are: 

1) Three questions with a seven point scale. 

2) Scores from the Peabody Picture Vocabulcury Test 
for intelligence. 

3) Scores from the Illinois Test of Psycholinguistic 
Ability for status of language development. 

4) The number of kernel sentences embedded in a 
T-unit for growth in language development. 

5) The number of behavioral objectives correctly 
demonstrated in a 70 (tentative numbe'*") item 
curriculum specific for acquisition of cognitive 
concepts . 
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6) The number of favorcU^le comments gleaned from 

the anecdotal records secured by the paraprofessionals 
for hoW well children relate to the television 
program. 

7) The numbef of modifications made in a television 
broadcast as a result of pupil reactions for how 
well pupil reactions affect program development. 

8) The number of kernel sentences in a T-unit and 
the number of behavioral objectives successfully 
demonstrated in the curriculum specific test for 
program components . 

b. Parent performance . Parent performance criteria are: 

1) Two questions each with a seven point scale for 
parent interest. 

2) The ntamber of behavioral changes reported by 
parents criterion for whether or not they notice 
any difference in their children’s behavior since 
enrolling in the program. 

3) The number of questions concerning the various 
components of the program for attitude of parents 
toward the various components. 

4) The mean percentage of tallies given to nine 
questions each with a seven point scale for 
parent motivational level. 

5) The mean will be calculated in the same manner as 
in the previous question, only for the "package” 
and TV plus home visitor groups . 
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6) The number of fathers and mothers that serve as 
the major contact for the home visitor. 

C- Paraprofessional per formance . For paraprofessional 

performance the criteria are: 

1) Four questions each with a five point scale 

determining relation of home visitors to children*s 
parents and to the children. 

2) The number of negative and constructive criticisms 
gleaned from anecdotal records for determining 
paraprofessional criticism of the program. 

3) Six questions each with a five point scale for 
how the home visitors relate to the personnel in 
the other program components. 

4) Six questions each with a five point scale for 
pardlprOfeSsional’s role. 

d. Mobile classroom teacher. The mobile classroom 
teacher performance criteria will be: 

1) Four questions each with a five point scale for 
determining how the mobile classroom teacher 

involves the parents and the mobile classroom 
activity. 

2) The number and kind of criticisms that the mobile 
classroom teacher reveals during a 20-minute 
interview fc^ major program criticisms. 

Six questions each with a five point scale for 
determining mobile classroom teacher involvement. 



3) 
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4) Six questions each with a five point scale for 
determining how the classroom teacher relates 
to personnel in other program components. 

3. Program Performance Pervasiveness . Criteria for pro- 
gram performance pervasiveness are: 

a. The number of 3, 4, and 5 year old children in the 
area where the TV broadcast is received. 

b. Number of parents in the area in which the program is 
broadcast. 

c. Number of school systems in the area where the pro- 
gram is broadcast. 

d. The number of superintendents, assistant superintendents, 
principals, vice principals, and supervisors. 

e. Number of first grade teachers in the school system 
where the program is operative. 

f. The total number of children under six years of age 
at October 1, 1968. 

g* 

4. Program efficiency . Ratios will be used as the criteria 

for answering program efficiency questions. They are: 

a. Number of pupils in area to total estimated cost 
for operating the program for those pupils. 

b. Number of pupils to total cost for operating the 
television element of the program. 

c. Number of pupils who can be served by one home 
visitor to the average cost of the home visitor 
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operation. 

d. Number of pupils who can be served by one traveling 
classroom to the total estimated cost of operating 
one for a year. 

e. A breakdown of the ratio in *a* above according to 
number of children per school system and number of 
school systems in operating area. 

5. Program synthesis . A synthesis of all the criteria in 
the previous four sections. 

II. COtliECTION OF DATA FOR EARLY CHILDHOOD EDUCATION EVALUATION . 

In this section the sources, instruments, sampling procedures, 
and schedule for the data collection will be specified. 

A. Sources of program effort data . Sources of evaluation data 
will be specified according to program effort, performance, 
performance pervasiveness, efficiency, and synthesis. 

1. Under program effort data sources are organized according 
to installation, operation, and maintenance. 

a. Installation . Data sources for installation are: 

Mr. Roy Alford, Dr. Robert Childers, Dr. William Bost, 
Mr. Don Nelson, Dr. Benjamin Carmichael, Mr. Robert 
Kennedy, and Mr. Jack Conrad. 

b. Operation . Data sources for operation are: 

Mr. Roy Alford, Mr. Jack Conrad, and Dr. Robert 
Childers . 

c. Maintenance . Same as previous section. 
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2. For progra*:i performance there are five sections of 
data sources. They are: 

a. Student performance . Children five years of age 
and under on September 30 ^ 1968. 

b. Parent performance . Parents of children enrolled 
in program. 

c. Paraprofessional j^erf ormance . The home visitation 
team. 

* ^ iifl 

d. Mobile classroom teacher . 

e. School superintendents, assistant superintendents, 
principals, vice principals, and teachers in the 
districts where the program is operating. 

3. Program performance pervasiveness . The data sources for 
this category will be Mr. Roy Alford, Mr. Kee Chang, 

Dr. Robert Childers, Director of Statistical Services of 
the West Virginia State Department of Education, and the 
Director of Census for the State of West Virginia. 

4. Progrctm efficiency . The data sources for this category 
will be the same as those in Nos. 1, 2, and 3 above. 

5. Program synthesis . Data sources for this category will 
be the previous four categories. 

B. Data collection instruments . Instruments are defined as 
tests, questionnaires, interviews, budget subcontracts, 
service agreements, memoranda and other documents from 
which data may be obtained for answering the questions 
posed in Section I. 
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1. Program effort . Data instruments will be organized 
according to Installation# Operation# and Maintenance. 

a. Installation . Instruments will be identified with 
the installation questions. 

1) AEL Early Childhood Education budget# subcontracts# 
service agreements# and invoices pertaining to 
purchasing of equipment for the program. 

2) Same as Number 1. 

3) Specifications for a central facility# subcontracts 
and service agreements . 

4) Subcontracts# and agreements with local agencies 
will service as the instruments tor data collection. 

5) Program plan# memoranda and structured interviews. 

6) AEL budget# service agreements and memoranda. 

7) Interview with Dr. Benjamin Carmichael and 
Mr. Robert Kennedy. 

b. Operation . Interviews with Mr. Roy Alford# Mr. Jack 
Conrad and Dr. Robert Childers. 

c. Maintenance . Interviews with the same people identified 
under Sectioii b. 

2. Program performance . Instruments will be organized 
according to students# parents# home visitors# and 
mobile classroom teacher performance. 

a. Student performance . Seven different instruments will 
be used for student performance. 

1) Attitudinal checklist will be the instrument for 



the interest level . 



2) Peabody picture Vocabulary Test will be the data 
instrument for determining the intelligence. 

3) The newest edition of the Illinois Test of Psycho - 
linguistic Ability and the latest version of the 
Pros tig Developmenta 1 Test of Visual Perception 
will bo the instruments used to determine the 
status of language development. 

4) T-unit analysis as described in a monograph by 
Norris# 0* Donnell and Griffin will be the instru- 
ment used to determine the growth of language 
development. 

5) A 70-item curriculum specific test^ developed from 
a list of 70 behavioral objectives will be used as 
the instrument for determining the number of 
behavioral objectives correctly achieved. 

6) Weekly anecdotal records will be the instruments 
used for determining favorable and unfavorable 
comments by paraprofessionals. 

7) Same instrument as in No. 6 

8) Same instrvunent as in No. 4. 

b. Parent performance . An attitudinal checklist for 

questions 1, 4# and 5 and a questionnaire for 

questions 2 , 3# and 6. 



This test being developed by Dr. Robert Childers# Dr. James Ranson, 
and Mr. Roy Alford# jr.# all from AEL# with the assistance of Dr. Ray 
Norris from George Peabody College# Dr. Frank Hooper from West 
Virginia University# and Dr. John Kennedy from the University of 
Tennessee. 
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c- Paraprofessional learning . A sixteon question 

attitudinal questionnaire for questions 1, 3, and 4 
and anecdotal records for question No. 2. 
d. Mobile classroom teacher . A ten question attitudinal 
questionnaire for questions 1, 3, and A, aud a 
20-minute interview for question No. 2. 

3. Program performance pervasiveness . Interviews, letters, 
local and regional census reports, will be the instru- 
ments used to answer questions *a* through *g* under 
program performance pervasiveness. 

4. Proqrcun efficiency . Interview will be the instrument 
for program efficiency. 

5. Program synthesis . A seminar of the decision-makers 
will be the vehicle used to gather data for the. program 
synthesis . 

C. Sampling for data gathering . Sampling will only be required 

for the program performance category. 

1. Student performance . A sample of 96 subjects stratified 
according to sex, age cuid treatment groups is the sampling 
plan . 

Geographical characteristics made it necessary to work with 

clusters^ of children in selected areas. The cluster areas 



^W. Allen Wallis and Harry V. Hoberts, Statistics: A New Approach 
(Brooklyn: The Free Press, Inc., 1956), p. 489. 
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and sample were selected in the following way:^ 

Forty-one areas were identified according to the following 
criteria: (1) Within the viewing area of WOAY-TV, Channel 4, 

Dale Hill, West Virginia, (2) within a county whose local 
educational agency had agreed to participate in the study, 

(3) not within an incorporated village, town, or city, and 

(4) an access road leading into the area. West Virginia 
State Hoad Commission maps, marked in grids of four miles 
by five miles, were used in this process. 

From the forty-one areas identified fifteen were 

i 

randomly assigned to one of three treatment groups: 

Tj^- television, home visits, traveling classroom; T 2 *tele- 

vision and home visits; and T 3 *television only. 

On September 2, 1968, surveys were initiated to identify 
the preschool children withxn each of the fifteen selected 
areas . 

In one of the areas it was learned that an ongoing 
kindergarten was in operation under a special grant. This 
area was discarded in favor of an adjacent one but outside 
the attendance area of the kindergarten. 

From each treatment group, dispersed through its . 
designated five areas, a random scunple of twenty-four sub- 
jects stratified by three age levels (three, four, and five) 
and two sex levels (male and female) was selected. 

^This section was written by Mr. Roy Alford and is a part 
of a dissertation prospectus submitted to the University 
of Virginia School of Education. 



Giles County, Virginia, was selected as a site for 
the control area. It lies Outside the viewing area of 
WOAY^Ir/ and does not have kindergarten classes in its 
rural areas. From a school census report a random sample 
of twenty-four subjects, stratified to the three age levels 
euid two sex levels, was selected for the control (T 4 ) group 
(See Appendix A) . 

For each of the two subsequent years a new sample of 
three year old children will be selected for the progtam. 
During the same period a new group will be entering the 

I 

first grade ,in their respective localities. Only one group 
will have participated for three years during the project, 
the ihree year olds enrolled September, 1968. (See Appendix 
C for the design) 

2. Parent performance . Random sample of parents stratified 
according to treatment group, and three levels of socio- 
economic status, will be the san^ling plan. 

3. Paraprofessional performance - N/A 

4 . N/A 
5 . N/A 

D. Schedule of data collection . All of the data are tentatively 
scheduled to be in office of the Director of Research oh 
June 16, 1969. 

X" 

ORGANIZATION OF THE DATA . 

The data will be organized according to the organization of the 
questions in Section I of this document. Specific procedures 
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for storing and retr:Leving this information are the responsibility 
of Mr. Kee Chang, Director of Information for the Laboratory. 

IV. ANALYSIS DF THE DATA ^ 

In this section the statistical techniques used to analyze the 
data will be outlined according to the questions asked in 
Section t. 

A. Effort . Descriptive statistics using graphs and neurrative 
reports in content analysis^ of technical documents will be 
the analytical techniques for program effort. 

B. Performance . Analysis of variance, (See Appendix A), chi 

square and descriptive statistics will be the analytical 
techniques for program performance. 7 

C. Performance: pervasiveness . Descriptive statistics will be 
used to analyze the data in this category. 

D. Program efficiency . Ratio of statistics will be the analytical 
techniques for analyzing the data in this category., 

E. Program synthesis . Content analysis of the data from the 
previous four sections will be the technique used for this 
category . 

V. REPORTING OF INFORMATION . 

At this time reports are scheduled for: 

1. AEL Board of Directors. 

2. Personnel within, Division of Educational Laboratories. 

3. The State Department of Education within the region. 
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4. Other educational laboratories. 



5. ERIC. 

The format of the report will be essentially the S 2 une as 
the annual Contractor's Request. Expected date of completion 
and submissicn of the report is September 15 « 1969. 



VI. MANAGEMENT. 



The management of this evaluation will be under the Director 
of Research and Evaluation of Ael. Tools used for management 



are "PERTING** and budgeting. 
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. DESIGN CONSIDERATIONS FOR THE ECE PROJECT 

Introduction 

* 

The following- constitutes a brief outline of rujor sources of 
variances that can be examined in relation to various phases of thc^ 

ECE evaluation strategy, ^fo temporal contexts are considered^ 

Specifically, attention Is directed first toward an assessment of various 
dependent variables for the first years (1968-69) operation and then, 

consideration Is given to the ^ana lysis of data for the three year project 

* 

period. It Is understood that the presented skeletal designs ate 

t 

subject to change especially during the first year, or pilot stjage, | 
of the project. 

A decision was .reached to attempt to control, or account for, six 
principal variables at various stages of the analysis. These variables 

remarks . 
between Ss 

between ;^s 
between Es 
repeated over £s 

repeated over ^s for 

the 3 yeAr peri<^ 

^ 

application Cor analysis 
of several of the social 
tasks 



are: 



variable 


levels 


treatiunts (T) 

(TV, tV + PP etc.) 


4 


age (A) 


3 


sex (X) 


2 


pre-post testing (P) 


2 


replications (R) 


3 


groups (*1) 


* 

t 




mm 
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Pilot, Yfear Design^ 

A 4x3x2x2 nixed serve during the first year for the 

anatysis of dependent yariablfes* in situations where pretest and; post test 
data is 4^aita^ie, Specifically,, such a design cpuld be einplpyed for 
analyzing data generated by the Pros tig, and PPVT etc* A graphic 

" H ; ■ " V. 

layout of this design is presented in Figure 1 (see Figure 1). The 
sbUrcU of yariances asTOciated with this design are listed below; 

Three Between and One within Mixed Design^ 



Source, 



df 



total 



Betv^en '^s 

t' " 

a:‘ 

X 



BC 

-.ite' 

^ £sy|M^ 

Within Ss 

rt: 

PA 

Fit 

m 

- - 

ptijc 

X^/tAX 



192 

95 

3i 

2 

1 

6 

3 

2 

6 

72 

94 

1 

3 

2 

i 

6 

1 

2 
6 
72 



*The four principal sain effects we assun^ to be fixed, 

b " ■ 

Total ^ are based on- the assumption that there will be four Ss 
per TAX cbinbination, . ^ 

*The blash nark; **'/**» d®uot®* "nested within," 



Valid F- tests for the above design are: 

XI) T, A, X, lA, TX, AX, TAX against Ss/TAX 

f * 

(2) F, P?, PAj PX, PXA, PAX, PTAX against PS/TAX 

’J 

$u^ of squares formuli can be Tnechanically derived from the degrees 
of ! freedom. Incidentally, the ANOVAR program (an in-house program) 
at; the University of Tennessee will take care of all the meclianics 

t * ' 

If :ybu string out the above listed sources of variance in the form of 
a nK>dcl. 

In addition, as suggested by Dr. Palmer, it would be most desirable 

t 

, to administer posttests to an additional randomly selected sample for 
tine purpose of estimating the magnitude of effect due to pretesting - 
treatn^jnt intcractioh. This procedure is knoi7n as the Solomon four-group 
design and is discussed in the Campbcll-Stanlcy chapter in Gage. If it 
:1s not feasible to posttest 96 ^s, then A8 Ss should be used. If the 
results of this nohorthogonal analysis should suggest a significant 
effect attributable to pre testing- treatment interaction, then this 
source of variance .should: be considered in subsequent designs. 

Since data relevant to the majority of social, cognitive and 
language development tasks will be generated solely from posttests 
during the pilot phase, a slmpller version of the design depicted 
above can be utilized. Specifically, the pre test-post test variable can 
be ignored resulting in a simple 4x3x2 factorial. 

" Undoubtedly,, there will be some social tasks in which a group 
effect must be entertained. This would apply, for example, in a 
situation where measures of social cooperation were recorded. During 
the first year, only posttest measures will be available, therefore. 




Ihcqrpoljcat^ng ^ i^ffect Injto the standard 4x3x2 deaign structure 

wtl^ periiiit an asseesinent of group effects. A diagram of the data 

I - H* ' ' 

ittatrlx ia cptitalned. lii; Figure 2. If a algnlf leant group effect should 
fDaterlallse, then the pse ol the group as the basic unit of measurcnicnt 
should be seriously epnalddye^* A listing of sources of variance for 
this hierarchical design Is presehted below: 

MerArchical. Design 




Source . df 



:-T6tal , 



' Se;feKpen- ;|E!a ' ■ ■ , 7* 

'/■■' i' 1- 

Git 4 

within Gs 88 

Av - ' , ' ■ " .2. 

tk ' 6 

iiGkit - • ■ '8 

■ ■ x' ■■ V ^ i 

lx 3 

exit 4 

AX 2 

tax 6 

GAX/T - 8 

i/GMC/T 48 



V '> 1 



yaiid T* taste far the above design are: 
, <i) t aj^lhst 
|2) Ajt/ ta, against GA/T 



This is based on the assumption: that a group Is compoaad 
12 students. 
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(3) X» rsn, against 6X/T 

(4) AX, TAX, against GAX/T 

(5) G/T, GA/T, GX/T, GAX/T against S/GAX/T 

There arc some problems with this design the most obvious being 
the lim;, ued number of ^ in the denominator with which to test the T 
main effect. This can be remedied by increasing the number of groups 
nested within levels of T. However, this would necessitate employing 
either A or X as a between groups variable (a group of 6 that arc all 
'^homosexual** — ha .. ha“*or a group of 6 that are all one age) if sample 
size is to remain constant. Another alternative would be to eliminate 
A Or X as ah incc^porated variable. Let's hold off on this decision 
until we have a little more information about the nature of these social 
tasks. 

Total Project Design 

The important consideration for the total design is that orthogonal 
comparisons will be made only within generations , i.e., a group (n = 96) 
that begins the program at the same time during the same year. Between 
generation comparisons will necessitate nonindependent comparisons. 

For a given generation, the overall design is similar to the 
4x3x2x2 Ddixed design discussed initially except that an additional 
yariabie, replications over the three years (R), is added. Thus, we 
have a three, between ^s and a two within ^s design. Assuming only 
tor the (^(teveinend no attrition, the sources, of variance would be; 



Thi^ee Retween - TWo Within 
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Source 



df 



Tot&l 



575 



Between Ss 95 

T “ 3 

A 2 

X 1 

1A 6 

7K 3 

AX 2 

TAX 6 

Ss/TAX 72 

Within Ss . 480 

F 1 

FT 3 

FA 2 

FX 1 

FIX 6 

FTX 3 

FAX 2 

FlAX 6 

SsF/XXX 72 



R 

RT 

RA 

RX 

RIA 

RTX 

RAX 

RXXX 

SR/XXX 



2 

6 

4 

2 

12 

6 

4 

12 

144 



PR 

PRT 

m 

FRX 

FRTA 

PRXX 

PRAX 

PRXXX 

SsFR/lAX 



2 

6 

4 

2 

12 

6 

4 

12 

144 



er|c 



Valid F- tests ere: 

(1) r. A, X, lA, TX, AX, TAX against Ss/X&X 

(2) P, FT, PA, FX, PTA, PTX, PAX, PTAX against SsP/TAX 

(3) R, RT, RA, RX, RTA, IRX, RAX, RTAX against SR/TAX 

(4) PR' PRT, PRA, PRX, PRTA, PRIX, PRAX, PRTAX against SsPR/TAX. 
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APPENDIX B 





Television and Home 
yUitotfon and Travel* 
Ing Classroom 


Television and 
Home Visitation 


Television 


Control 




HI 


5 


5 


5 


5 


26 


Medium 


5 


5 


5 


5 


20 


tow 


5 


5 


5 


5 


20 




15 


15 


15 


15 


56 ^ 
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SAMPLING DESIGN FOR 3 YEAR PERIOD 



Enrollment Date for 3, 4, & 5 Year Old Children 



September 

1968 



September 

1969 



September 

1970 



September 

1971 



enter 1st grade 



enter 1st grade 



enter 2nd grade 



enter 1st grade 



enter 2nd'grade 



enter 3rd grade 



1 year operation 



2 year operation- 







7 



3 year operation 



APPENDIX B 



ANALYSIS OF INTEREST USVBL 
OF PRESCHOOL CHILDREN . 



Analysis of Children and 
Parental Interest 



IN AEL-ECB PROJECT 



One important phase of the evaluation was to determine whether or not 
the Early .Childhood program could maintain the interest of the children and 
parents participating in the program. This information was considered to be 
important since the assumption was made that the children should learn from 
the program and that they should enjoy learning. Since the parents were ah 
important part of the children's le6uming process ? it was felt chat readings 
on their interest should be obtained. 

Interest and attitude were used synonymously, and were theoretically 
defined as the strength of feeling a child or parent held concerning the 
television programs at a particular time. Attention ^an of the child, amount 
of time the child watched the program and the general cooperativeness of the 
child were assumed to be criteria of interest. Cooperativeness and enthusiasm 
were criteria for parental interest. 

The instrument used to gather the data for child and parent interest and 
attitude was a six question checklist. The first two questions had a seven 
point scale, and they were directed to the parents. The third and fourth 
questions had two seven point scales each and they were directed to the parents 
The fifth question had three seven point scales and it was directed to the 
children. The seventh question on the instrument pertained to the quality of 
TV ruception. tSee Appendix J for a copy of the checklist.) 

The operational definition was the percentage of tallies recorded in the 
most favor^d>le categories of the seven point scales. The variance was not 
generated from the percentage of tallies across the seven point scales for 
each question, but it was generated from the percentage of tallies in the most 
favorable categories for each question across the thirty-two weeks that the 



data were collected- 




hiu g m. li H U 









y.^ ’ 



X>ne of' the probl^s with using tMs Instrument was 1±e bias Inherent ah 
. gathering ttte data. TIm hqiK visitors weora iised tp gather the data and they 
V. Were also an Integral pa^t of the prograh. It was reasonable to ekp^ct that 

they would be; biased In favor bf the program. A second difficult problem was 
the difficulty the home visitors experience In discriminating between the bi*- 
pplar adjectives. 

From a cursoi^ glance at the tallies on the checklists during the early 



K} 



o , 
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^irt Qf the; year It was evident that- the bias was clearly in favor of the 



program, i^e entire yOar 78 percent of the resenses were in the most: 
favoraUsle categories. Homver# It Was reasonable to eKect that bias acOouhted 



for only etf fpct that ^st tallies we_:^ in the Inost favorable; category 



and that, the di^^ Sons true effect Ih malntaiblhg a high level of 

interest* 



One question with three scales (Question Vl) pertained dlreOtly to the. 



interest level. of. the children., the. procedures for achieving the measure of 



Interest from these three scales were somewhat complicated. The^ home yisltor 
record^ her impressipn on the checklist after she had visited the hosie. She 
; recorded her Impressions on all six questions of the checklist. 

i*he recorded checklists weM subsequently turned over to the research 






division. At that time the number Of iaw tallies for each Of the seven :polhts 



for each scale were converted tp percentages. The percentages weie ^talhed by 



dividing the> total of responses for each scale into the number of res^hSes 



for' each point.^ along that scale. As discuasad above one question with three 



seven point, scales was used for assessing the chlldrah*s interest, ^e meah 



percentage of responses In the most favorable category in these three scales 



was used as the measure of pupil Interest for study. 

liable I OQh tains the mean percentages Of tallies recorded on point 1 of 
the scales (the must favOrable category) for each week diirlng vdilch measures 
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vrere taJcen. The first measures vrere taken during the vreek of October 3, 1968 
and the last measures were taken the week of May 21, 1969. In all measures 
were t^^cen for twenty five vreeks during the first year's operation. 

The checklist contained five questions pertaining to parental attitude 
and one question pertaining to the child. The mean percentage of tallies 
recorded in point one on the scales for parents during the year was .763 and 
for the children it was .653. The coi^elation between the percentage of 
tallies for parents and for students during the year weis 0.87. Thus seventy- 
six percent of the variance in parental interest was cOTimon with the variance 
in pupil interest. This common variance was expected since the observers 
recorded their impressions of the parents and the children at the same time, 
erne slgniflcjmt finding was the difference of 0.11 percentage points in favor 
of the parents over the children. 

The t-test for correlated means Was 15.25. So it waS reasonable to con- 
clude that the difference between the tvro was a true difference. Both the 
rorrelatlon and the difference is graphically depicted in Figure 1,. 

Another significant finding was the difference in d^ree that the parental 
interest and the cliildren's interest declined. The parental interest declined 
0.116 mean ^rcentage points and the children's interest declined 0.090 mean 
percentage ^ints. The parental interest declining more than the children's 
interest could have been due to the “halo. effect“ wearing off. It was reason^d>le 
to conclude that parents wpuld have been more sensitive to the newness of the 
program than the children. 

From these data it was reason^d>le to conclude (1) that the Early Child- 
hood Education progrmn did instill and maintain a high level of interest for 
both the parents and the children, and (2) that the parents had and maintained 
a higher level of interest in the program than did the children. A possible 
source of concern from these conclusions was that the high parental interest 
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in ^e'px<)grai^ coald ^sslbly have a restive effect oh the children. Ih 
other wprd^ thfere was a danger the puents cduld force /'the children 
to participate and thereby contribute to e child "dro^^ing out of school" 
^before he even started. 
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Table I 

Attitude Check list Survey (ACS) 



4t^ 



The numbers recorded in the table below represent the percentage 
responding at the most extreme positive level on the differential 
scale for a given category. The item given is for the cumulative 
total for the week ending on date in the left column. Sample survey 
sheet is on next page. 



Week Ending . (^estions 



Date 


I&II 


IV 


V 


I,II/III 

IV6V 


VI 


VII 


10/3 


.851 


.783 


.774 


.778 


.743 


.863 


10/10 


.846 


.753 


.714 


.747 


.697 


.928 


10/17 


.856 


.739 


.788 


.745 


.673 


.819 


10/24 


.906 


.796 


.798 


.805 


.757 


.900 


10/31 


.906 


.781 


.849 


.813 


.703 


.827 


11/6 


.916 


.801 


.860 


.847 


.745 


.876 


11/13 


.942 


.812 


.865 


.846 


.762 


.856 


11/20 


.913 


.766 


.802 


.784 


.673 


.815 


12/4 


^886 


.644 


.663 


.692 


.580 


.608 


12/11 


.898 


.653 


.785 


.738 


.611 


.870 


12/20 


.923 


.709 


.885 


.773 


.626 


.899 


1/9 


.902 


.677 


.783 


.774 


.599 


.896 


1/15 : 


.950 


.774 


.813 


.790 


.718 


.930 


1/30 


.926 


.810 


.922 


.813 


.679 


.916 


2/6 


.928 


.772 


.870 


.792 


.705 


.909 


2/13 


.945 


.828 


.944 


.842 


.668 


.889 


2/19 


.902 


.763 


.832 


.769 


.653 


.910 


2/26 


.881 


.775 


.804 


.822 


.704 


.863 


3/12 


.890 


.708 


.833 


.756 


.624 


.837 


3/25 


.913 


.761 


.834 


.756 


.668 


.725 


4/16 


.875 


.692 


.732 


.710 


.621 


.882 


4/23 


.919 


.718 


.786 


.752 


.617 


.865 


5/2 


.667 


.614 


.614 


.597 


o452 


.851 


5/12 


.879 


.719 


.777 


.719 


.568 


.885 


5/21 


.850 


.644 


.716 


.662 


.529 


.827 


Mean 


.871 


.739 


.803 


.763 


.653 


.853 


SD 


.053 


.057 


.072 


.057 


.073 


.071 



I & II 

IV 

V 

I, II, III, IV, V 

VI 

VII 



Parent Attitude to ECB Program 
Parent Attitude to TV 
Parent Attitude to Materials 
Parent Total Attitude 
Child Attitude to TV Lesson 
TV Reception 
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APPENDIX C 



ANALYSIS OF IQ GAIN ^ . 

Analysxs of IQ Gaxn of Preschool Chxldfen 

OF BCX CaiLOitEN 

In the ECE curriculum, intelligence was placed in the same category 
as cognition. However, for purposes of evaluation it was broken out sep- 
arately. The mean gain raw scores and mean gain IQ score and the respec- 
tive gain standard deviations are incited in T^d>le 1. The highest IQ 
gain, 19.25, was experienced by the three year old female in the control 
group. The mean raw score gain was 21 and the gain standard deviation 

i 

was 13,04, The four year! old males in the van group experienced tlie least 
IQ gain, -3,00,- with a negative mean raw score gain of 1,6 and standard 
deviation of 33.39. Although this is a large range, statistical analyses 
performed, which %rill be discussed subsequently, indicated no significant 
differences . ; 

T^d>le II presents the sunmiary of the cuialysis of covariance of the 
Peabody Picture Vocabulary Test scores using the pretest scores as the 
covariate, and the post-test scores as the variate and controlling for 
age and sex. There was one provocative F-ratio and that was the age by 
sex interaction. 

No hypotheses have been advanced to eiqtlain why this might occur. 
Figure I graphically depicts this age by sex interaction. At three years 
of age the gain is the same. At four years of age the male subjects have 
a higher gain than the female subjects, and at five years of age the female 
subjects have a higher gain than the male subjects. It is difficult to 
explain why the disparity occurs between three and four years of age, and 
subsequently this disparity reverses itself from four to five years of age. 

A s 

• i 

One explanation is that this disparity is an artifact of the testing situa- 
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tion. That is, as the children get progressively older they react differ- 
ently to the testily situation. At three years of age it makes no difference; 
at four years of age it could be that the male subjects are less sensitive to 
the situation and the female subj cts are; and at five years of age this 
situation could be r^ersed. A second explanation is that this represents 
a true picture' of child growth and development, whatever the reasons may be. 
Kany other e^lanations are also plausible. Since this interaction has 
been observed in a number |o£ different sets of data, it probably is worthy 

I 

t 

of further investigation. 
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TABLE I 

GAIN IQ SCORES BY TREATMENT, AGE AND SEX 
AS DERIVED FROM PF\;T RAW SCORES 





1 


2 


3 


4 


Sex 


TV+PP+VAN 


TV+PP 


TV 


CONTROL 


M 


Mean 3«50 


15.75 


12.75 


1.00 




S.D. 20.60 


21.55 


17.09 


14.65 


F 


( 8.83 


-1.83 


2.00 


19.25 




16.09 


13.26 


23.26 


16.82 


M 


13.60 


12.67 


2.00 


4.25 




11.06 


20.60 


22.02 


4.79 


F 


-3.00 


6.25 


0.00 


4.60 




22.57 


13.45 


5.10 


16.77 


M 


22.40 


4.25 


4.00 


8.06 




16.50 


12.18 


18.17 


8.28 


F 


10.83 


24.00 


9.75 


33.25 




13.93 


17.21 


13.82 


19.24 



RAW SCORE MEAN GAINS AND STANDARD DEVIATIONS 
OF PEABODY PICTURE VOCABULARY BY TREATMENT, AGE AND SEX 





1 


2 


3 


4 


Sex 


TV+PP+VAN 


TV+PP 


TV 


CONTROL 


M 


7.33 


16.25 


14.75 


6.00 




14.72 


13.65 


11.30 


8.91 


F 


14.83 


7.17 


10.00 


21.00 




8.31 


6.97 


13.81 


13.04 


M . 


15.60 


11.67 


3.00 


4.00 




5.73 


11.72 


14.31 


1.63 


F 


2.00 


7.00 


4.80 


7.80 




12.75 


8.08 


2.95 


7.73 


M 


-1.60 


3.50 


4.00 


7.40 




33.39 


5.07 


7.58 


6.62 


F 


8.33 


14.50 


7.50 


19.25 




7.10 


11.36 


4.66 


9.32 




4.97 


10.01 


7.34 


10.90 
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TABI£ II 



Treatment 

Age 

Sex 

Treatment 
Treatment 
Age X Sex 
Treatment 



AHALVSIS OF COVARIANCE OF SUMMARY TABI£ 
FOR PEABODY PICTURE VOCABULARY RAW TEST 
SCORES WITH PRETEST SCORES AS COVARIATE 
AND POST-TEST SCORES AS VARIATE 





Sum of S<tueu:e 


df 


MS 


F 




131.00 


3 


43.6 


0.42 




270.00 


2 


135.0 


1.30 




97.50 


1 


97.5 


0.94 


X Age 


567.00 


6 


94.4 


0.91 


X Sex 


599.00 


3 


200.0 


1.93 




585.00 


2 


293.0 


2.83 


X Age X Sex 


513.00 


6 


85.5 


0.83 




8902.49 


86 


103.5 





Within 
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FEMAI£- 
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Figure 1 

Graphic Depi^icHi Of Age by Sex 
interaction of PFVT Raw Gain Scores 





APPEKDIX D 



DETAILED ANALYSIS OF LANGUAGE DEVELOPMENT 
OF PRESCHOOL CHILDREN IN ECE PROGRAM 

Introduction 

Originally the objectives for the early childhood education program 
were divided into four major categories — motor activities, language sklllSir 

cognition, and orienting and attending skills*^ This report was concerned 
with the language skills category of objectives. 

One of the difficulties associated with evaluating language skills was 
the loo% fit between avail^d>le theoretical definitions of language and 
operational definitions of language. Often language is not theoretically . 
defined at all, and must be Inferred frcmi the operational definition vdiich 
is the measure being used. The procedure of inferring the theoretical 
definition from the measure being used often creates a biased fit between 

i 

theory and operation and more specifically often creates a problem of test 
relevancy. 

For the first year's early childhood operation the theoretical definition 
was implied from the instrument used to measure language — The Illinois Test 
of Psychol inguis tic Abilities (ITPA) . The definition of language, therefore, 
was the definition used by the authors of the ITPA. 

The decision for using the ITPA was justified on the basis that it was 
used as a primary Instrument in gathering data for the development of the 
early childhood curriculum objectives. The decision assumed that the ob- 
jectives of the early childhood curriculum were directly influenced by this 
instrument, and that this was a reason^d>le justification concerning the 
relevancy of the ITPA to objectives around vdiich the early childhood education 

^Frank H. Hooper and william H. Marshall, The Initial Phase of a Preschool 
Curriculum Development Project (Charleston: Research and Information Center, 1968} 
p. 99. 

^tbid. pp. 76-89. 
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programs were developed. 

The remainder of the report is organized according to the model under- 
lying /Rie Illinois Test of Psycholinguistic Abilities , the presentation of 
the datav and a discussion of ^e results. 

The Model of the ITPA 

According to the authors of the ITPA, the theory underlying the test is; 

To relate those functions whereby the intentions of one individual 
are transmitted (verbally or nonverbally) to another Individual, 
and, reciprocally, functions whereby the envirc^unent or the 
intentions of another individual are received and interpreted. It 
atteiq>ts to interrelate the processes udiich take place, for example, 
when one person receives a message, intesrprets it; or becos^s a 
source of a new signal to.be transmitted. It deals with the ■ 
psychological functions of the individual which operate in oonnunica- 
tion activities.'^ 

For the early childhood education, functions were transmitted by tele- 
vision, by paraprofessionals visiting the homes, and by a professional teacher 
in a van. The receivers of the coomunication were the three, four, and. five 

year old children. This, briefly,' was the rationale for using the ITPA as 

' ^ 

a measure for language development in the AEL-ECE program. 

/ 

Upon examining the^^/Ob jectives that were used in the curriculum during 
the first year, and cooparing those with the test items in the ITPA, only 
Subtes't V of the ITPA was found to be directly related to those objectives. 

Figure 1 depicts the gain scores achieved On each of the subtests 

t 

* 

according to the four groups in the study. 

Three*rw.ay analysis of variance on the gain scores was the statistical 
analysis used. The factors in the analysis were four levels of treatment, 
three levels of age, and two levels of sex. The four levels of treatment 
were the television plus par€^rofessional plus the van, television plus 



^Samuel A. Kirk, James J. McCarthy, and Winifred D. Kirk, Examiners Manual 
Illinois Test of Psycholinguistic Abilities , (Urbana; The Board of Trustees 
of the University of Illinois, 1968. 
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paraprofessional, television, and zero control. The three levels of age 
were three, four and five year olds. The two levels of sex were male and 
female. Analyses %«ere conducted on each of the ten subtests and the total 
test. 

ITPA Subtest One, Auditory Reception 

Auditory reception measures the ^d>ility of a child to derive meeming 
frtoi verbally presented material. Since the receptive rather than the 
expressive process is being sanpled, the response throughout is kept at the 
simple level of a "yes” or "no” or even a nod or shake of the head. The 

I 

vocabulary beoaoes more and more difficult vdiile the respmse remains at a 
two-year level. Similarly, the automatic function of determining meaning 
from syntax has been minimized by retaining only one sentence form* ^e 
test contains 50 short, dire'ct questions printed in the manual. Typical 

items are> "to dogs eat?" "to dials yawn?" "to carpenters kneel?" "to 

* " ■ ^ 

.wingless birds soar?"^ 

For the ITPA Subtest One, the analysis of variance on the gain scores 
produced a treatment by age interaction significant at the .003 level. 

Figure 2 graphically illustrates the treatment by age by sex Interaction. 

The interaction appears to be a phenraienon of differences in the control group 
and the remaining three groups as a unit. As expected from the analysis of 
mean gain scores, the three year olds, four year olds and five year olds 
achieve gains in ascending order with the exception of the control group, and 
there the three and five year olds reversed themselves on tiie mean gain scores. 

TaUsle I presents the sumnicury table of the analysis of variance of the 
gain scores. T^d>le IX presents the means and standard deviations of the gain 
scores for the Subtest One by treatment, age; and sex. . 
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^Ibid , p. 9. 
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6i:aphic Depiction of Treatment by Age Interactic^ 
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TABLE I 

SUHtti^ TABIE FOR ^ALVSIS OF VARIANCE OF GAIN SCORES 
FOR ITPA SUBTEST #1 (AOpITORSf RECE^ION) 



ANOVA 





sun of 
Stpiares 


Degree of 
Freedom 


Mean 

Square 


F 


P 


T 


110,25 


3 


36.75 

V 


1,47 


0.23 


A 


lp4.?d 


2 


52.45 


2il0 


0.13 


s 


63 . 55 


1 


63.55 


2i53 


0.12 


txa; 


552 ;66 


6 


89.11 


3.60 


0.003 




69.06 


3 


23.02 


0.92 




A3S 


■■ 


2 


24.85 


0.99 




T3UXS 


135.18 


6 


22.53 


0.90 




Error 


2303.68 


92 


25.04 
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TABLE II 



MEANS AND STANDARD ESVIATIONS OF 
PRETEST AND GAIN SCORES ON ITPA SUBTBST ONE 
ACCORDING TO TREATMENT AGE AND SEX 



AGE 

(Years) 


SEX 


Sta- 

tistic 


TV+PP+'' 


niN 


TV+PP 


. TV 


CONTROL 








Pre 


Gain 


Pre 


Gain 


Pre 


Gain 


Pre 


Gain 






n 


6 


6 


4 


4 


6 


6 


4 


4 




M 


X 


19.00 


.2.00 


16.00 


4.00 


5.25 


' SO 


8.25 


8.25 


3 




SD 


11.68 


7.40 


4.29 


2.94 


2.22 


4.93 


5.56 


3.20 






n 


6 


6 


6 


6 


6 


6 


■ 4 


4 




F 


X 
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ITPA.Sqbtest Two, visual Receptl<» (Visual Decoding) 

visual reception test Is conparable to the JUidit(>ry Reception Test 
but utirizes a different sense 'SK>dality. It is a neasure of the child* s 
ability to gain neaning froa visual symbols. In this test there are 40 
plctuiK! Itemsr each consisting of a stimulus picture on one page and four 
regpmise pictures on a second page. The child is shown the stimulus picture 
for three seconds with Ute directions^ "See This?" Then the page of response 
pictuxes is presented with the direction, "Find one here." The credited 
choice is the abject or situation which Is conceptually similar to the 
stimulus. The other choices include pictures with varying degrees of 
structural (rather than functional) similarity or pictures which are 
associated with the stimulus or with the acceptable choice.^ 

The analysis of variance of the gain scores yielded a treatment by 
age by sex Interaction significant at the .09 level. Figure 3 gri^ihically 
depicts the treatment by age by sex Interaction. The Interaction ^ipears 
to be a phenomenon of differential variation In bhe performance of the four 
year old boys and girls across the treatment groups. ‘ In .the television, 
^araprofesslcnal and van group, the male and female four year olds gained 
{Approximately the sane. In the television and pi^raprofesslohal groiqp, the 
four year old males gained far more than the four year old fonales. In the 
television groi;p, the four year old med.es and females gedned the same, and 
In the control, groi^ the four year old males and females gained more than 
the four year old males. Table III presents the suiaiary table for the 
analysis of variance of the gain scores. Table IV presets the means and 
standard deviations of the gain scores for ITPA Subtest Two according to 

®Ibld, p. 10. 
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Graphic illustration of Treatment 
by Age by Sex Interaction of ITPA Subtest Two Gain Scoims 
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TABI£ 111 



SUMM^ TABl^ FOR ANALYSIS OF VARIANCE OF GAIN SCORES AND 
AND ANUYSIS OF COVARIANCE OF GAIN SCORES USING fRinEST 
SCORES AS A ObVARIATB FOR ITPA SUBTBST TWO 

ANOVA 
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TABLE IV . 

MEANS STANDARD OeVIATIOMS ITPA 
SUBTEST TWO (VISUAL RECEPTION) PRETEST AND GAIN SCORES 

BY TRBA1MENT, AGE AND SEX 
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treatments age^ and sex* 

ITPA Subtest Threes Audltory^Vocal A»ooclatlop 

This meaaure taps the dilld's ^illty to relate oonoqpta presented 
orally* In this test the requirements of the auditory receptive process 
and the vocal expressive process are minimal s idiile the organizing process 

A 

of manipulating linguistic syi^ls In a meaningful, way. Is tested by veid>al 

■ , . 

analogies of Increasing difficulty*. A sentence completion technique Is 
usedi: presenting om statmoMnt followed an Incomplete analogous statements 

Ir, ^ ' 

and allowing the child to- complete the seomd stat!ement a^ r opriately * There 
are 42 orally presentefd analogless- such ass "1 cut With a sawi I pound with 
a "A dog has hairi. a fish has *"^. . . 

The analysis of variance of the gain scores yielded a significant 
difference between the suaes and females at the *03 level* mean gain 
for the males was 3*07 and the mean gain for the females was 2*05* TableV 
presents the sianaary table for the analysis of variance on the gain scores* 
TUble yx presents the mean gain scores -by treatments, a^ a^ sex for 
Subtest: three* 

XTPh Subtest ^^ {Visual-^^ Association) 

The 'organizing process in this channel Is tapped by a picture assocla* 
tioh test with which to assess the diild's; Sblllty to relate concepts 
presented visual ly* The child Is presented i^^ith a sihgie ' stimulus picture 
surrounded by four optional plCtuTSSs one of <dild) -Is- associated with the 
Stimulus plctuure* The dilld Is askedr "Nbat g^s i^th thls?*^ (pointing to 
the stimulus picture) * "Which one of thess?" (pointing to the ^our optional 
pictures) * The child Is to dxx>se the one picture whldi Is mbst closely 
related to the stimulus picture , such as a sock belonging with a Sheer or a 

^Ibld r p* 10*. 
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TABLE V ' 

SOMMABY TABLES FOR ANALYSIS OF VARIANCE OF GAIN SCOPES AND 
ANALYSIS OF COVARIANCE OF GAIN SCORES USING PRETEST 
SCORES AS COVARIATE FOR ITPA SUBTBST THREE 
(AUDITORY VOCAL ASSOdATtON) 

ANOVA 
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TABI£ VI 

MEANS AND STANDAW DEVIATIONS FOR ^A 
SUBTEST THREE (AUDITORY VOCMt ASSOCIATION) PRETEST AND GAIN SCORES 

ACCORDING TO TRIfATHENT, AGE AND SEX 
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haniner with a nail. The teat is expanded at the upper level to provide 
visual analogies conipar^le to the auditory analogies. "If this goes with 
this** (pointing to each of a prelininary pair of pictures) ^ "then lAat goes 
with this?" (pointing to the. central pictuire as before) ^ The test consists 
of 20 items of the sijnpler form and 22 vimal analogies.^ = 

Analysis of variance of the gain scores yielded a statistically signifi- 
cant finding for treatment effects at the .03 level.' .^e analysis of covari- 
ance yielded significant findings for age at the .001 level. The gro^ 
receiving the television^ paraprofessionais and van, and the group receiving 
television only experienced the highest g«dn, being 5.14 and 5.37 respectively 
The groiq^ receiving television and paraprofessional ^q^^enced 2.59 gain 
units, and the control group experienced no gain. Table VII presents the 
sismiary table for the analysis of variance of the g«dn scores and the 
analysis of covariance of the g«dn scores using the pretest as a oovariate. 
Table Vlll^resents the mean gain scores and standard deviati<xis by treatment 
age and sex for this test. 

V ■ 

ITPA Subtest Five (Verbal Expression) 

The purpose of this test is to assess the ability of the child to 
express his own concepts vocally. The cMld is shown four familiar Ejects 
One at a time (a ball, a block, an envelope, and a ixitton) and is asked, 

"Tell me all about this." The score is the nuaber of discrete, relevant, 
and afproximately factual concepts expressed.^ 

Analysis of variance on the gain score yielded a treatment effect 
significant at th^> .002 level, a treatment by age Interaction significant 

t 

at the .04 level, and a treatment by age by sex Interaction significant at 
the .07 level. 

^Ibid , p. 10. 

^Ibid, p. 11. 
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TABLE VII 

SUHHAFY TABLE FOR AKALYSIS OF VARIAHCE OF GK^ SCORES 
AND ANALYSIS OF OOVARiANGE OF GAIN SCORES USING 
PRE^T SCORES AS COVAiaATE FOR ITPA SUBTBST 
FOUR (VXSUAL-MGTOR ASSOCIAIION) 

ANOVA 
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tabu: VIII 

MEANS AND STANDARD DEVIATIONS OP PRETEST AND GAIN; SCORES 
FOR ITPA SOBTEST POOR (VISUAL-MOTOR ASSOCIATION) 
ACCORDING TO TREATMENT, AGE AND SEX 
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Figure 4 depicts the treatment by age by sex interaction. The inter- 
action is partially explained by the performance of three ^ four^ and five 
year old males in the television plus paraprofessional group and the 
television group, in each of those - o groups^ measures on the three year 
olds i^owed more gain than measures on the four and five year oldsr and 
measures on the five year olds in these two groups indicated negative gains. 
The interaction is also partially explained by the fact that measures on the 
five year olds in the television^ paraprofessional and van group indicated 
far superior gains than measures taken on any other of the categories of 
students . 

treatment effect is partially explained by the fact that the tele- 
vision plus paraprofessional plus van group had an average gain of 4.37 unit;b. 
which is significantly more than the gains recorded in the remaining three 
groups. The gain for the television plus paraprofessional plus van group was 
4.37 units. For the television plus paraprofessional group it was 0.05 units. 
The gain for the television group was 1.41. And for the control group the 
gain was 1.63 units. 

Table IX presents the summary table for the analysis of variance on 
the gain scores and the analysis of covariance on the gain scores using the 
pretest as the oovariate. Table X presents the mean and standard deviation 
of the gain sco^s by treatinentr age and sex<^ 

It is noteworthy ^at this subtest was the only one vdiich had items 
v^ich correlated directly with the objectives used in the program as recorded 
during the months of April and Hay of 1969. The objectives were (1) identify 
and describe an object in terms of its physical characteristics r (2) identify 
and describe an object in terms of its function r and (3) identify and describe 
an object in terms of its location. These correlate very directly with Sub- 
test five vdiich measures veribal expression. Verbal expression for this test 
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Figure 4 

Graphic Depiction of Treatment by Age 
by Sex Interaction for the ITPA Subtest Five 
(Verbal Expression) 
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TABLE IX 



SUMMARY TABLES FOR ANALYSIS OF VARIANCE OF GAIN SCORES 
FOR ITPA SUBTEST FIVE (VERBAL EXPl^SION) 

ANOVA 
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TABI£ X 



MEANS AND STANDARD DEVIATIONS OF PRETEST AND GAIN SCORES 
FOR ITPA SDBTBST FIVE (VERBAL EXPRESSION) 
ACCORDING TO TREATMENT, AGE AND SEX 
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is defined as the child's ability to express his own oonceypts verbally In 
terms of concrete properties. These properties may pertain to ph^lcal 
characteristics r functions^ or relatlcms to other dbjects. 

ITPA Subtest Six (Manual Expression) 

j 

Subtest six taps the child's ability to express ideas manually. This 
ability Is assessed by gestural manipulation tests. In this test fifteen 
pictures of oomnon dbjects are shown to the child cme at a time cind he Is 
askedr "show me what to do with a ." The child Is required to pantomime 

Q 

the i^roprlate action^ such as dialing a teleplxme or playing a guitar. 

Anal^ls of variance of the gain scores yielded a treatment effect sig- 
nificant at the .02 level. Analysis of covariance on. the gain score using 
the pretest as the oovarlate yielded treatment effects significant at the 
.001 levels and an age effect significant at the .01 level. The group 
receiving television achieved the highest gain with 4.54 units. 

The mean gain for the television ^ par€^rofessional and van group was 
2.85. The mean gain for the television plus paur^rofessional group was 
negative^ 0.6. The mean gain for the televlslcm only group was 4.54r and 
the mean gain for the control group was a negative 1.02. 

Table XI presents a summary table of the anal^ls of variance of the 
gain scores and the analysis of covariance of the gain scores using pretest 
scores as a covarlate. Table XII presents the mean gain scores of the ITPA 
Subtest six according to treatment^ age and sex. 

ITPA Subtest Seven (Graamatic Closture) 

This subtest Is for assessing the child's ability to make use of: 

The redundancies of oral language In acquiring automatic habits 
for handling syntax and granmatic Inflections. In this test the 

^Ibid, p. 11; 



TABLE XI 



SUMHARV TABLES FOR ANALYSIS OF VARIANCE OF GAIN SCORES 
FOR ITPA SUBTEST SIX {MANUAL EXPRESSION) 

ANOVA 





Sum of 
Squ^es 


Degrees of 
Freedom 


Mean 

Square 


F 


P 


T 


689.04 


3 


229.68 


3.28 


0.02 


A 


211,26 


2 


105,63 


1-51 


0.23 


S 


103.70 


1 


103,70 


1.48 


0.23 


fXA 


394.62 


6 , 


65.77 


0.94 




TXS 


11 0.1 6 


3 


36.70 


0,52 


- 


AXS 


21.52 


2 


10.76 


0.15 


- 


T3AXS 


132,96 


6 


22.16 


0.32 






6440,92 


92 


. 70.01 
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TABLE XII 

I4EANS Am) STi^ARD DEVIATIONS OF PRETEST AND GAIN SCORES 
FOR ITPA SUBTEST SIX (MANUAL EXPRESSION) 
ACCORDING TO TREAOMENT, AGE AND SEX 



KGE: ' 
(Tears) 


- 

SEX 


Sta- 

tistic 


TV+PP+VAH 


TV+PP 


TV 


CONTROL 








Pre 


Gain 


Pre 


Gedn 


Pre 


Gain 


Pre 


Gain 






n 


6 


6 


4 


4 


6 


6 


4 


4 




H 


# 

X 


17.67 


5.67 


16.25 


-1.50 


19.00 


7.25 


14.75 


-2.2T^ 


3 




SD 


10.48 


8.04 


5.56 


12.29 


.82 


6.99 


12.53 


5.38 






n 


6 


6 


6 


6 


6 


6 


4 


4 




F 


X 


18.67 


4.33~l 


10.33 


1.33 


18.50 


6.17 


20.00 


2.50 






SD 


9.05 


3.93 


6.59 


8.91 


5.32 


3.82 


' 7.70 


5.26 






h 


5 


5 


5 


5 


5 


5 


' 4 


4 




N 


X 


. 22.00 


0.20 


22.00 


1.67 


32.75 


0.25 


24.75 


0.75 


4 




SD 


4^30 


6.76 


6.08 


7.02 


4.19 


1.71 


2.75 


9 . 14 




. - 


n 


4 


. 4 


5 


5 


5^ 


5 


5 


5 




P 


X 


^0^5 


2.75 


20.40 


3.40 


28.20 


2.40 


17.80 


0.80 






SD 


^^7_9_ 


3.20 


6.31 


7.20 


5.63 


3.85 


7.76 


3.77 


" ■ 




n 


6 


6 


5 


5 


6 


6 


5 


5 




N 


'X 


26.83 


2. 00 


25.20 


-5.80 


29.17 


5.67 


27.00 


-9.20 


5 




SD 


4.83 


2 . 90 


8.26 


13.57 


5.60 


6.15 


27.12 


"2^23“ 




* ' 1 


n 


; - .6 ■ 


; 6- 


5 


5 


4 


4 


4 


4 




P’ - 




25.83 


2.17 


27.40 


-2.80 


29.25 


5.50 


24.50 


1.25 




* 


SD 


6.46 


4.66 


5.90 


7.63 


6.13 


3.70 


TTrSTl 


1.71 



-t 
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cOTcep^Uftl difficulty Is low, but the task elicits the child's 
ability to reload autonatlcally to often repeated verbal 
expressions of standard American speech. The child comes to 
e)^Qt or predict granmatlc form so that when part of an 
expression is presented he closes the gap by suiplying the 
missing parts. The test measures the form rather than the 
eontiiht of the missing word, since the content is provided by 
the examiner. 

There ^e 33 orally presented items accompanied by pictures 
idilch portray the content of the verbal es^resslon. ^ie 
pictures ara included to avoid cxmtamlnatlng the test with 
difficulty in the receptive process. Each verbal item consists 
of a complete stateront followed by an incomplete statement to 
be finished by the child. The examiner points to the appropriate 
picture as he reads the given statements, for example: "Here 
is a dog? here are- 

The dialysis of varlwce on the gain score yielded a treatment effect 
si^ifiosnt at the .003 levels The group of children receiving all three 
eimiMnts of the program scored the least gain on this subtest. Those 
receiving the television plus parflprofesslcmal and the television group 
scored the seoc^ highest gain. The gain for the television, paraprofesslonal 
;and- van group was ^01& wilts? the gain for the televlslcm only group was 
3.47 units? the gain for the control grOwP was 2.18 units. 

Table preswits the simnmary table of the analysis of variance of 

the ga^ ' scores and the analysis . of covariance of the gain scores using the 
pretest M a covarlate. Tidsie XIV presets the means and standard 
deviations of; the gain scores on the ITPA Sub test seven according to treatment, 
'age .and: Sex.,-' • 

ITPA Subtest Ei^t (VisuSl Closure) 

This test is to t^: 

The c^ld^g eblllty to identify a conmon abject from an Incomplete 
ylsuail presentati<Mi. There are four scenes, presented separately, 
each containing 14 or 15 examples of a specified abject. The 
objects- are seen in varying degrees of concealment. The child is 



10 



Ibid, P* 



li 



TABLE XIII 



SUMMARY TABLES FOR ANALYSIS OF VARIANCE 0? GAIN SCORES AND 
ANALYSIS OF COVARIANCE OF GAIN SCOR^K USING PRETEST 
SCORES AS COVARIATE FDR ITPA SUBTEST SEVEN 
(GRAMMATIC CLOSURE) 

ANOVA 





Sum of 
Squares 


Degrees of 
Freedom 


Mean 

Square 


F 


P 


T 


209.10 


3 


69.70 


4.87 


0.003 


A 


36.30 


2 


18.15 


1.27 




X 


2.56 


1 


2.56 


0.18 




TXA 


138.60 


6 


23.10 


1.61 


0.15 


TXS 


39.84 


3 


13.28 


0.93 




AXS 


16.64 


2 


8.32 


0.58 




TXAXS 


115.62 


6 


19.27 


1.35 




Within 


1315.60 


92 


14.30 










r 

t 




i 

i 






- ■■ 
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TABLE XIV 

14EANS AND STANDARD DEVIATIONS OF PRETEST AND GAIN SCORES 
FOR ITPA SOBTEST SEVEN (GRAMMATIC CLOSURE) 

ACCORDING TO TREATMENT, AGE AND S^ 



AGE 

(Years) 


SEX 


Sta- 

tistic 


TV+PP+VAN 


TV+PP 


TV 


CONTROL 


3 


M 


h 


Pre 

6 


Gain 

6 


Pre 
4 _ 


Gain 

A 


Pxe 

6 


Gain 

6 _ 


Pre 

4 


Gain 

4 




10.33 


-3.00 


7.00 


4.00 


4.50 


3.50 


5.25 


3.75 


SD 


3,^0 


5.02 


A. 41 


_ iJ7 


2.08 


1,29 


5.91 


4.27 


F 


n 


& 


- 6 _ 


6 


_ _6_ 


6 


6 


4 


4_ 


X 


11^83_ 


-1-67 


6.33 


1.33 


5.33 


3.50 


6-75 


3^0_ 


SD 


4L71 


3.67 


1-97 


2-58 


1-63 


1.51 


6.19 


3-31 


4 


M 


n 


5 


a 


5 


5^ 


5 


5 _ 


'i 


4 


X 


9.40 


2.00 


8.67 


3.67 


12-75 


4.50 


11.00 


1.00 


SD 


2-30 


. 2-S5 


2.08 


5-51 


6-40 


4.51 


^.56_ 


7.07 


P 


li 


4_ 


4 


5 


- 5 


5 _ . 


5 


5 


'■ 5 


E 


10.25 


-1.00 


12.00 


3.20 


9.00 


3.00 


11.80 


0.60 


SD 


7,14 


4.32 


3.16: 


1.79 


2.92 


2.00 


7.83 


2.30 


5 


M 


h 


6 


6 


5 . 


5 


6 


6 


5 


5 


5 


17.33 


0.50 


15i20 


3.40 


13.33 


1.83 


,5.40 


5.00 


SD 


7.39 


2.66 


9.07 


3.44 


4.55 


2.48 


1. 52 


2.34 


P 


n 


6 


6 


5 


5' , 


4- 


4 


A 


4 




9.33 


3.83 


15.40 


4.40 


12.00 


4.50 


18.25 


^0.75 


SD 


3.50 


4.88 


-5.13 


5.55 


4.24 


3.70 


10.87 


6.55 





28 



asked to see how quickly he can ^Int to all exaiq>les of a 
particular object within a tine limit of 30 seconds for 
each scene. 

Analysis of variance of the gain score yielded a statistically sig- 
nificant effect for ■ treatment at the .05 level. The two highest gains 
were es^rienced by the children In the package group, 4.04 units. The 
television jmd par€^rofesslonal group gained 2.89 units and the control 
group had a negative gedn of Q.28. \Table XV presents the sunraary table 

for the analysis of variance on the gain scores and the analysis of c6- 

1 

. variance using the pretest as a covarlate and the gain scores as the . 
variate. ; Table XVI presents the means and standard deviations for 
Subtest eight ackwrdihg to treatment, age and sex. 

ITPA Subtest Nine (Auditory Sequential Memory ) 

^e puTj^se of this test is; 

TO assess the child's ability to reproduce from mmnOry sequences 
of digits Increasing In length frqia two to eight digits. The 
test differs from the digit repetition task of the Stanford Benet 
or i^e Wise In that the digits are presented at the . rate of two 
j^r second' Instead of one per second and in that the child is 
allo««d.a second trial gf each se<^ehce If he falls 6n the first 
presentation. He receives more credit for a success on the first 
than on' the sepemd trial. A more: rapid presentation niakes the , 
task easier, tdii^ iS necessary for the two and the throe year old 
children. 

One striking thing In ^Is analysis was the xero gain for the group 
having the teievislon, paraprof esslonal , and van experience. The group 
receiving teleyislon only achieved the next highest, and the control group 
received the third highest. Table XVII presents the sunsnary table for 
the analysis of variance of the gain scores and the analysis Of edvariahee 
of the gain scores using the pretest as a covarlate. Table XVIII presents 
the inean and standard: deviations for the subtest nine gain scores by treatment, 
age and sex. 



^%id, p. 12. 



^^Ibid> p. 12 



TABLE XV 



SUHMAra TABLES FOR ANALYSIS OF VARIANCE OF Gkttl SCORES 
FOR ITPA SOBTEST EIGHT (VISUAL CLOSURE) 

ASOVA- 





Sum of 
Squares 


Degrees of 
Freedom 


Mean 

Square 


F 


P 


T 


360.30 


3 


120.10 


2.69 


0.05 


A 


202.$8 


2 


101.44 


2.27 


0.11 


S 


47v33 


1 


47.33 


1.06 




TXA 


70.32 


6 


11.72 


0.26 




TXS 


168V09 


3 


56.03 


1.25 




AXS 


143.74 


2 


71.87 


1.61 




TXAXS 


180.30 


6 


60.05 


1.34 




Within 


4115.16 


92 


44.73 
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TABLE XVI 

ANt> STAliDAHD D^IATIONS OF PRETEST AND GA^ SCORES 
Fok ITPA SOB^t EIGHT (VISD^ CLOSURE) 
ACCORDING TR^THENT, AGE AND SEX 



MaB 

(Years) 




sta- 

tistic 


TV^PP+VMI 


TV+PP 


TV 


CONTROL 






; : 


Pre 


Gain 


Pre 


: Gain 


Pre 


Gain 


Pre 


Gain 






n , . , ' 




6 


4 


■ ' 4. 


6 


6 


' . -4. 


4 




H 


S 


9. so 


• ' 'l.'56'j 


13.25 


-0.25 


8.75 


4.25 


18.50 


-1..50 


, - '3 




SD 


3.08 


l.ail 


.50 


4.27 


1^ 


3.10 


4.12 


1.73 




.. 1 


n 




; 3-/ 


. .. '6 


r 6 . 


6 


6 


4 . 


4 




F 


5 


9.83 


i:47_ 


9JL7 


2.00 


12.00 


2.17 


9.75 


. 1.75 






SD 


3.87 


2.42 


3.B5 


5^25 


2.76 


3.60 


1^26 


1.89 




- r 


h 




5 


5 


5 ■ 


' 5 '■ 


5 . 




- A . 




: n 


X,. “ 


11.20 


■ ::i.2o 


14.33 


1.00 


IS.©*) 


2.25 


15.00 


4.00 


4' 




SD- 


r ,:2.i95:- 


: 4Ji Sj 


i.56 


6^93 


i:6o 


4ai 


3.83 


7cl6 










. 4' . ■ 


' : : 






5 .■ 


5 


5 




T '■ 


% 




^.06 


12.20 


2.20 


13.60 


4.00 


21.80 


-7.20 






SDi 




; 3.46' 


'.'.'.,'3.-42' 


V .':3.7,7; 


3.78 


4.74 


29. 10^ 


■ 24.0: 




y ■ 


.7 




v\: "6V.'‘ 




. . . .. 5_ . " 


6 


; .6 


5 


5 




■R '' 




-ii J;7- 


4.17 




J5440 


19.50 


-0.17 


JL2^4(L 


0.80 


5 


, ■ 


O'sD,-.'.,.,; 




3.66 


_2.m 




' -4.23 


4.58 


5.27 


3.83 






':ni 


'8; 


' : 6 . 


. . -5^ 


■■■5 ' ■ 


4 




4 


4_ 




r : 


It 


14^17' 


. 7.6* 


is. 60: 


: 7.00 


15.25 


11.50 


16.00 


0<S0. 


..... 




stt 




5.37 


3-91 


- 7^0 


2 8 36 


l-OO' 


7.30 


— 
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TKBIC XVII 

SUHHMRY TABLES FOR ANALYSIS OF VARIANCS OF G)^ SCORES ITPA 
SOBTBST NINE (AUDITORY - SEQUENTIAL MEMORY) 

ANOVA' 





Sun of 
Squares 


De^wes of 
. FreedoB 


Mean 

Square 


r 


P 


T 


486.96 


3 


162.32 


4.85 


.004 


A 


26.96 


2 


13.48 


0.40 




S 


83.46 


1 


83.46 


2.49 


0.12 


TXA 


131.46 


6 


21.91 


0.65 




TXS 


125.67 


3 


41.89 


1.25 




A^ ' 


38.18 


2 


19.09 


0.57 




TXAXS 


230.46 


6 


38.41 


1.15 




Within 


3081.72 


92 


33.50 
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1ABLE XVIII 

. * 

NBAHS AND STANDARD DEVIATIONS OF PRETEST AND GAIN SCORES 
FOR ITPA SUBTBST NINE (AODITORT-SBQDEIITIAL MBIORT) 
ACCORDING TO TREATMENT, AGE AND SEX 



MCE . 
(TMr«) 


SEX 


sta- 

tistic 




TV+PP 


TV 


OONTBOL 








Pxs 




PCS 


Gain 


Pes 


Gain 


Pcs 






• 


■n 


6 


6 


4 


4 


6 


6 


4 


4 




M 


I 


13.67 


0.33 


14.25 


2.25 


7.75 


8.00 


5.25 


4.50 


3 




6D 


6.09 


7.28 


4.65 


4.03 


2.50 


7.39 


4.43 


2.38 






n 


6 


6 


6 


6 


6 


6 


4 


,4' .. 




F 


* 


13.83 


-1.17 


9.17 


4.50 


8.67 


4.33 


15.25 


-1.50 






SD 


7.65 


6.74 


3.71 


2.66 


4.32 


5.32 


2.99 


4.44 






n 


5 


5 


5 


5 


5 


5 


4- 


4 




N 


X ■ 


12.60 


1.60 


22.67 


4.33 


18.50 


6.25 


14.50 


8^00 


4 




SD 


8.88 


8.02 


9.07 


1.16 


6.25 


7.23 


3.87 


7.75 






n' 


4 


4 


5 


5 


5 


5 


5. 


5 




■ F 


X 


20.50 


-4.5 


19.80 


3.40 


19.80 


6.00 


9.60 


3.00 






SD 


12.07 


9.75 


6.06 


4.83 


8^95 


4^85 


5.42 


3. 8r 






n 


6 


6 


5 


5 


6 


6 : 


5 


5 




N 


X 


20.83 


-2.83 


16.60 


6.20 


24.17 


1.67 


12.40 


5.20 


5 




SD 


" 4i54 


8.75 


5.18 


6.11 


6.34 


2.58 


5.90: 


4.S7C 








6 


6 


5 


5 


4 


4 


4. = 


4 




- F- 


iL 


17.67 


2.83 


22.40 


2.20 


18.50 


3.25 


17.00 


-0V50 






w ^ 


8.82 


7.30 


9.79 


2.39 


2.38 


1.89 


5.94 


1.92 
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ITPA Subtest Ten (visual Sequential Hemory) 

According to the authors > 

This test assesses the dilld's ability to reproduce sequences 
of ncMi-^anlngful figures frosi n o aory* A child is shown each 
sequence of figures for five seconds and then Is asked to put 
corresponding chips of figures In the sane order. Here again 
the child is allowed two trials on each sequence idien the 
first attespt Is unsuccessful. Tte sequences Increase In 
length fron two to eight figures.^* 

The analysis of variance for Subtest ten gain scores yielded a treat* 
Bwnt effect significant at the .02 leveli the analysis of covariance yielded 
a treatnent effect significant at the level; an age effect significant 
at the .001 level. One surprising finding was that the group with the tele- 
visloof parapxofesslonal and van ei^rlenoed negative gain, while the 
reaaining three groups experienced gnins of at least three units. Table xix 
presents the sivary table for the analysis of variance of the gain scores. 
Table XX presents the nean gain scores by treatnentr age, and sex for 
Subtest ten. 

ITPA Total Test 

The ocaposlte score for the total test yielded no significant differ*- 
ences frcn the analysis of variance of the gain scores. Analysis, of 
variance on the gain scores of the total test scores yielded an age factor 
significant at the .001 level. 

The total gain for the three year olds was 28.44; for the four year 
olds It was 22.02; and for the five year olds It was 27.83. Ostensibly^ 

. this suggests that In general for language develCEnent the three and five 
year olds are wore sensitive to the testing situation or are maturing at 
a faster rate than the four year dds. 

Table XXI presents analysis of variance Binary table end Table XXIX 
presents mean gains and standard deviations of total tests. 



o 
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TABLE XIX 



SaHMAIOr TABLE FOR AHXLISIS OF VARIANCE OF GAIN SCORES FOR 
ITPA SOBTESt TEN (VISUAL SEQUENTIAL NEMORI) 

ANOVA 





Sum of 
Squares 


Degrees of 
Freedon 


Mean 

Square 


E 


T 


330.42 


3 


110.14 


3.30 


A 


52.02 


2 


26.01 


0.78 


S 


156.29 


1 


156.29 


4.68 


TXA 


127.02 


8 


21.17 


0.63 


TXS 


8.37 


3 


2.79 


0.08 


AXS 


20.62 


2 


10.31 


0.31 


TXAXS 


370.08 


6 


61.68 


1*85 . 


within 


3071.51 


92 


33.39 





TABLE XX 
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MEANS AND STANDARD DEVIATIONS OF ITCA 
SUBTEST TEN (VISUAL SEQUENTIAL HEHORY) 
PRETEST AND GAIN SCORES BY TREATMENT, AGE AND SEX 



RGB 

(Years) 


SEX 


Sta- 

tistic 


TV4PP4VAII 


TV+PP 


TV 


CONTROL 








Pxe 


. Gain 


Pxe 


Gain 


Pxe 


Gain ' 


Pxe 


Gain 






n 


6 


6 


4 


4 


6^ 


6 


■ 4_.. 


4 




M 


i 


6.50 


1.-33- 


8.75 


3.00 


4.50 


7.25 


1.25 


5.00 


' 3 




SD 


3.27 


5.05 


4.50 


2.15 


5.79 


2J)6 


^SQ 


1.63 






n 


6 


6 


6 


6 


6 


6 


4 


4 




F . 


S 


9.00 


1.17 


6.50 


1.33 


7.00 


3.50 


J.25 


5-75 






SD 


6.26 


5.56 


3.45 


3.44 


1.55 


4.72 


4-72 


5.56 






n 


5 


5 


5 


^ 5_ 


5_ 


5 


- 4 


4 




M 


S 


7w40 


4.80 


8.00 


4.00 


13^25 


1.75 


8.25 


4.75 


4 




SD 


3.51 


- 5.36 


2.65 


7.81 


2*^50 


4.11 


4.11 


3-95 






ik 


4 


4 


5 


5 


s 


5 


5 


5. 




F- 


% 


33.00 


-6.50 


12^60 


5.40 


15.80 




12.80 


1.00 






&> 


10.80 


11.27 


4.04 


7.09 


4.97 


3.29 


6.18 


4.18 






n 


6 


6 


5 


5 


6 


—6 


5_ 


5 




M 


1 . 


13.50 


2.33 


12.80 


7.40 


15.00 


b 

o 

< 


11-40 


3-60 


5 




SD 


6,47 


9.61 


4.61 


6.11 


4.94 


6.54 


5.27 


4-34 






n 


6 


6 




5 






4 


4 




F ' 




14.33 


-1.17 


14.80 


0.60 


20.25 


-pI.25 


14.75 


2-75 






SD 


8.54 


8.40 


^ 


5.86 


-50 


3.10 


-5.06 


3-7ft 
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TABLE XXI 

SUHHARY TABLES FOR ANALYSIS OF VARIANCE OF GAIN SCORES 

FOR ITPA TOTAL TEST 

ANpVA 





Sum of 
Squares 


Degrees of 
Freedom 


Mean 

Square 


* 

. P 


P 


T 


2239.53 


3 


746.51 


1.94 


0.13 


A 


884.60 


2 


442.30 


1.15 


0.32 


s 


148.93 


1 


148.93 


0.39 




TXA 


, 3069.54 


6 


511.59 


1.33 


0.25 


TXS 


353.52 


3 




0.31 




AXS 


480.96 


2 


240.48 


0.63 


- 


TytAXS 


2400.58 


6 


400.93 


1.04 


* 


Within 


. 35375.00 


92 


384.52 
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TABU XXII 

HE2^S AND STANDARD DEVIATIONS OP PRETEST AND GAIN SCORES 
FOR TOTiUi I^A ACCORDING TO TREATMENT, AGE AND SEX 



Ikge 

I(y«ar8) 


SEX 


iti^ ] 

tistic 


TV^PFfVAN 


TV+PP 


TV 


CONTROL 








P.M 


.Gain 


Pre 


Gain 


Pxe 


Gain 


Pee 


Gain 






n.. . 


s 


.. 6 


4 


4 


6 


6 


4 


A 




M : 


X.' 


126.501 


23.33 


113.25 


24.00 


76.00 


50.50 


71.75 


28.50 


3: 




SD 


34.80 


19.03 


27.56 


24.14 


11.75 


23.95 


46.28 


20.63 






:nr:: 




6 


6 


. 6 


6 


6 


4 


4 






i 


135.33 


17.67_ 


92.83 


23.67 


98.17 


33.33 




26.50 






SD 


46.88 


15.56 


11^00 


13^41 


25.68 


17.95 


39-18 


14.98 


X . J 




-h '■ 


5 


5 


5^' 


5 


S 


5 


^ 4_ 


JL. 




H 


.x'.\ 


127.20 


21.00 


146.33 


23.67 






56.75 


29.25 


■■■ 4 




SD 


37JI5 


: 26^11 


15.63 


34-49 


33.47 




^^21 


31.10 










■; 4, 


5 


5 


5 


js _ 


5 


5 




■ ■ ^ 1 


: * • . 


172.50 


rii.25 


J.63.Q0 


17.60 


165^ 


24J10: 


129.40 


27.40 






SD 


9»^ 39 


19.29 


256 49 


»r Iff -it 1 1 VWt'l K 


12.93 






n ' 




S 


' ; -'..'s,- 


' 5 . 


6 


6 


5 


5 




M ■ 


i :: 


‘2Q4j3: 


27:i33 




25.60 


203.17 


28.50 


125.00 


25.60 


- 5- ' 




SD 


f-'-S'iJ&'l 


"10.97 


49..7D 


19.63 


l37.19 


17.26 




17.44 








^ S' 


: ' 


. 


"5 


■ ■4 


4 


.x-a-V' 


4 ' ■ ■ 




f. ; 




isiB^oo: 


39.17 


201.00 


21.40 




48.75 


25.25 


6 . 25 


• . ^ 


r ' i 


Iv'SD ' 


72.78 






24.05 


i ^‘47 


25-62 


724.88 


1IL44. 
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The original question was concerned with idietber or not the program 
appears to be having any effect on the language developaient of tbs children. 
The answer to this Is a qualified yes. The one subtest of the t^ irttlch 
correlated directly with the objectives used In the progran^ when analysed^ 
produced a statistically significant treatpent effect. . This significant 
difference when graphed showed that the subjects receiving the television, 
panqprofesslonals and van did achieve far aore gain than tiiose subjects In 
the other groups, suggesting that the van Is having a substantial ippact 
on the trait neasured by the ITPA Subtest five. This further suggests a 
ve^ important relationship between the activities in the van wid those 
objectives In the currlculue oonoemed with children being able to describe 
objects in teres of physical, characteristics# being able to des^ibe an 
object In teres of its function# and In teres of Its location. 

The octroi grotgp achieving higher gains than the other gtoiipB is 
puszling. Aeong eany alternate hy^theses there are at: least twp Which 
eay account for this pebenoaienon. First, there is the possibility of test 
reaction. This Is when the students achieve leazhing froia taking the 
test. The ITPK Is an extresMly ocepllcated test, taking apprmdMtely 
40r60 elnutes to aAainister* Xt Is reasonable to wqpect that this amnmt 
of time devoted to testing would Itself have an effect on the response of 
the subjectSt A second hypothesis Is tiwt those students in the control 
group are being exposed to other pro^aap whldi tend to facilitate the 
develc^rnent of traits laeasured by the ITPA. 
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i; I 49 guage behavior reported here was autt^rlzed 






’ " vy ^^4 Laboratpi^ as part of the assessment of Its 
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■< >5 with^ pfes<?hopl 6^^ in cammihltles of West Vli^lhla. Subjects for 

V: ihvesMAetioh :b refcelved three t^es of educational Intervention, 

^ tyeatSient B, and ti^atmeht G. 

4v /V^ h il^olVed^ home yiisltatipn, g^PPP nP^ programmed training 

treatment 4' consisted: of hpn^ visitatijcm and the tel^lsion 
^eAtn^nt: C was Whplly dependeiit <m the televlslpn training,. 



H.V.- 












]£iOh of the laboratory's three treatments Was ap;plled to children 






^■ middle^ and older age groups, .which ?>1 11 here 



^5f;5 : VM deA 1, 2, and 3:. Whatever the prlglnal composltlpn 









of these jgr^ bave been^ the laggu^e espies available for analysis 
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pf chlldten. there Is alsP a wide 
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V; ^ \ range oj age^^^^ and this fact should be kept 
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in miu4v^etl internet atldn of data reported in this study IS offered. 

the other hand^ it is true that se^an age S of children ih subsets Pi a 
Single age groups ^ vei^: different, table 1 shows the mean age and 
agd-ra;^e Of tke thr4e age groups given eack treatment, computed as Of 



May 25, 1969. In making the Individual computations, no account was taken 
of periods up to 16 days beyond a full month, but 16 days or more were 
counted as a ^ole month. Table 1 also shows the numbers of children In 
the various categories \diose language samples have been analyzed In this 
Inves tlgat Ion . 

y Table 1 

t 

Numbers of Subjects, Mean Ages, and Age Ranges In 

Nine Categories 
(Ages reported In months) 





Age Group 1 
Mean Age Range 


Age Group 2 
Mean Age Range 


Age Group 3 
Mean Age Range 


Treatment A 


46.90 


44-54 


59.75 57-62 


71.22 


67-74 




n ® 


10 


n « 10 


n « 


9 


Treatment B 


48.60 


44-55 


62.00 57-66 


73.00 


68-77 




n » 


8 


n =* 10 


n *= 


10 


Treatment C 


48.56 


44.-55 


.61.40 55-66 


72.89 


67-78 




n = 


9 


n « 9 


n ^ 


9 



On the basis of treatment labels and age group designations, the nine 
categories of subjects of this study may conveniently be referred to as 
Al, A2, A3, Pl, B2, B3, Cl, C2, and C3. 

The Purposes p.€ the Study 

the analysis of language behavior conducted In this investigation was 
Intended to apply objective measurements to language production of children 
affected by the Appalachia Educational Laboratory's three types of educa- 
tional Intervention and to compare the language behavior of subgroups of 
those children. It was also planned to make possible various comparisons 
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the coUection of language sjraples from ^lldreh with «h<m it had 
. ^ . ^rked^ fplljpwing a procedurje intendiMl to be comjparable to that employi^ in 
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. of the leakage prodMction by the Vest Virginia children with that of 
V^dergarten in Tennessee reported by Q'Donnell, Griffin* and 

Norris {'1967).. It was set np tP provide evidence ch grP^S vbliiblHty, 

• * ' ' ■ ' 1 ^ 

niiehcy, and syntactic conttpl. Children's syntactic control was to be 

cy 

^asurad in of their rates of use of certain languagS structures. 
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Language Samplea Collected .for AhalySis 
tatb in the spring of 1969, the Appalachia Educational Laboratory 
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the study reported by p'pot^ Griffin, and Norris (1967). As in the 
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investigatlpn* subjects were shown tWP eight ~v4nute ttoyie films* 
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= . aaiinated cartoon versions of Aesop's fables of "tme Ant and the Dove" and 
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^i. ;''The North Wind at^ the Suni” (The f ilms ate found in the Coronet Language; 









Atts seties . ) Each movie whs shown with the sound turned off, to preyeht 












influence of ^e harrator 'a language on that to elicited from the chiid 



/''-"'v-:-:''- ’A-:; 



. ->A- ^ 



1^0 yieVed it.^ When a child had seen <me of the films* he was asked to tell 
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What he had seen and to coranent on the"lesson" pointed up in the fabler 
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l^tet, he saw :^he second film and was encouraged ip respond to it in the 
isa^ way. The interviewers' talk and; children's oral responses weie recorded. 
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meghetic tspes ^ which were transmitted to the Institute pn School Learning 



Differences at Geoi^e Peabody College for Teachers. Tran^ 
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seriptipns ir^ those tapes, carefully verified tp assure accuracy*. cPhstitute 



;;:iht'ia analyzed- in thi'a inyaitigatiCh. 
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it mu si he ndied that .the intent to follow the ianguage siMspiihg 
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A arcnedures appHed in ikirfreesbprp, Tennessee* waa not fully realized. 
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Interviewers in Murfreesboro were strictly confined to preplanned formulas 
to elicit the child's recounting of what he had seen in the movie. (Example: 
"Now, in your own words, I would like you to tell me the story of 'The Ant 
and the Bove.'") Control of their manner of stimulating the child to 
comment on the "lesson" of the fable was not quite so rigid, but Murfrees* • 
bpro intenriewers closely followed instructions to hold. their unplanned 
conversation to a minimum. West Virginia interviewers, however, regularly 
led chiTdren through series of questions and cues that had few common 
patters, in only a few instances did West Virginia children proceed 
through an extended^ uninterrupted, narrative of' what they had seen in the 
films Most frequently, they responded briefly to queries and promptings, 
often in elliptical expressions of denial or assent, in other syntactically 
incpmpi^te.,c<mstructions,^pr^^4P^ esiserbibns such as. '*1 don't know." At 
some points, quite irrelevant conversations developed; they were excluded 
from £ui£^ly8is Atid reporting. 

FPr the most part, no doubt, the practice of the West Virginia 
.int^^/iewers was a response to unwillingness or inability of the children 
to offer unassisted accounts of what they had seen and how they had 
interpreted the films. The possible implications of this assumption will 
be discussed later. 

So^ difficulty developed in the recording and transcription of the 
children's l^guage samples. The speech of one child (a boy in subgroup 
B5) was so indistinct that it could not be properly deciphered. Responses 
of two pther children interviewed (one in subgroup Al, the other in subgroup 
A5) could npt be located on the tapes; quite likely, when they were inter* 
viewed the recorder was not operating properly. Names of these three 



' '■ ■ ' ■ . . ' ' ■ . ■ ; > ' " '■ •5 

. ^ . --i. ■ ’ ‘ ^ ' 

tb - . ' ' , 

' - - . . ' ■' 

children irtll be found in Appendix A » idiich also lists » in the subgroups 
to vhich they belongs the 84 children whose language saaples have been 
analyzed. 

In ally a total of 15>712 words produced by the children were subjected 
to study. 

A 

Analysis of the Language Sasples 

A 

The verified transcriptions of children's oral responses » after eiiiii*r 

nation of irrelevant conversation y were first marked to ^entify audible 

pauses (the oral signs of hesitation usually transcribed as "uh") and 

garbles (false starts , aWoxmal redundancies y and hopelessly tanglad syntax). 

Thus freed frost cluttery the recorded speech sanqples were then segmented 

into whaty ^following Hunt (1965) y are called T-nnitSy short for "sdnimai 

terminable syntactic units." A complete T^unit is the hind of syntaotic 

construction traditionally identified as a grammatically complete sfi^ls 

1 

or cooler (but not costpound oi^ compound-cos^lex) sentmice. If an 
expression lacl^ either a subject or a predlcatey or bothy it is in this 
study (for convenience and with some theoretical justification) called an 
incomplete T^nit. 

T^units (both complete and incomplete) were ladividually entered on 
analysis sheetky one of which iS attached to this report as ^pend^ B. 

Items listed' bn the analysis sheets Include a word count and a record of 
whether the T-unit was complete or incomplctey as well as a count of garbles 
and audible pauses in it. The greater part of the analysis sheet (69 items) y 



1 . Advantages of employing the !S*unit as the basic reference unit in 
studies of children's language are demonstrated by Hunt (1965) and O'Donnelly 
Griffiny and Norris (1967). 



however 9 reletes to l^idence of syntactic features of the T^nit . Entries 

'''K . ' 

on ^e analysie sheet i^ll he exjpl^ned In the next section^ of this report . 

(Kccuxreitoe of any feature named on the anal^is sheet was recorded. 
Analysia of Trunits lu;^ rrcordii^ of their syntactic features were 
performed liy competent individuals, but ea^ analysis sheet was rechecked 
by ;^e director of this Investigation. 

Supmsaries of; all analysis sheets for each individual child constitute 
the raw data from whidi the ipore refined statistics reported here have been 
derived* l^e summaries comprised not only stupa of occurrences specificaUy 

ft ' * 

nsiapd on the anel^j^is sheets but also reports on incidence of responses 
consist ing <miy of siegle^word expressions of assent or dissent. Incidence 

' ' y 

of other pne'-mrd respcmses, total incomplete iiuiits consisting of more than 

T' ^ ^ ^ 

*flae wbrd|: >tOtal ault^^ units, and total words in multiple -wrd 

nnits . (*^ltiple-wOrd units'* Include. aH those composed of more than 
one wp^^) - . 

-At this ;^lnt, an explanation Of the word count is In order. Cus- 
tOMi^ entries in standard dictionaries were generally depended on for 
identification of Individual words, but two special rules were adopted. 
Contractions such as don't« Isn't < and he'd were counted as two words, 
and ordinary cosqpound nouns were giv^ the count indicated by the number 
of baaes; cosqraunded. Thus motorcycle was counted as two words (a noun 
adJunct/P a -noun^, as was windmill or bedroom . But words such as sometimes 
and anything were not regarded as '^ordinary compound nouns;" they were 
counted as single words.. 
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Ebcplanation of Items on the Analysis Sheet 

Most of the items entered on the analysis sheet were selected for 

attention because investigations have shown then to be significant in 

assessment of language performance of preschool and elementary school 
2 

children. 

i ■ ■ - 

Since the intent was to provide for possibilities of a ^ite hi^ 
upper limit of language maturity, some items were included that were un- 

t 

. j' 

likely to occur in the speech of six-year olds. Examples are ”introductbry 
adverbials with inverted subjects,** "Expanded phrasal verbs," "Pre-posed 

series of three or more adjectives," "Post-posed series of two adjectives," 

^ * 

and "Post^posed series of three or more adjectives." On the other hand, 
the groups of. iteito relating to negations and questions would ordinarily 



figur^importantiy only in the- study of language acquisition of children 
younger than those dealt %dlth here. By age four, normal children 
c^rhctieristicaliy have effective command of these resources. The items 

4 ^ ^ 

on negations and questions were included in this ^dialysis because -they 
were given special attention in the syllabus prepared by Hooper and 
Marshall (1968): for the work to be carried on with the West Virginia 
preschpol children. 

Syntactic features identified in the analysis sheet as "simple 
structures" are those explained in the transformational theory of grammar 
as. being derived from a single base. "Complex structures" are those 
accounted for in transformational theory as deriving from two or more 
syntactic bases. A glance at the analysis sheet will show that it 



- 2. See, for example, Templin (1957), Loban (1963), Hunt (1965), 
O'Donnell, Griffin, and Norris (1967), and Menyuk (1969). 
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Identlflesi; «pM gc^irai; Categories of; syntactic atructurea that are 
brok^ daWh into compon^ts, the hierarchical relationships bsing 

, r „ ‘ ' ^ 

indicated idehtation* ^nerallyji then, the sum of parallel Indented 






.dhtries would Indicate ^ total occurrenqea of the feature categorized 



' in the superior heading (vln the next left position) Immediately above 
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• An ;excdption to this rule la made, hOi^er, for the entriea, 
"Itll.ipjtical^ and "Elliptical queationsj'- and the exception la 



; r indicated, by thel;r aingularity; they are not breakdowns of a auperior 

fc;-'*;- \v. ■ ^ ^ 

./^-'categor^^. 

V / Many of the. entries on the' analysla sheet are ao traditional in 
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fo>* that 'they-.tieed' 
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iccpunte^^ ; 'for '/her 



t^y .iiieed no ^cpli^tion* iikpse that loay raise queations will 



here in the order in; iA>lcl> they appear on the ahalyals 









\ VI ' iniHnieat? ona. so called 



> 0 ^^^eetfond*, so called because wany of them begin with worda like 
who, what « where, iAtv^ are questions that cannot be answered aimply by 

'l'’ 3''<^":'V'-''^yes" or '”no 
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constructions are thoae that have an empty word in the 






s' 






subjijact position, while the. actual subjeot la expreased later in the 
clause* The coiipWMiea kind of expletive construction may be ^empllfled 
V. by the. sentence / "There are three children here." Another typs is 

■'“" v.- " -f ■ 

llluStrsted) in "lt;s'is true that X ran away;" 

Xntroducto^ adverbials with inverted subject are exemplified by 

l^:V";o'-cV ''“Iftien c 
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in this analyals, expanded phrasal verbs are arbitrarily defined . 

as verbal expressions consisting of a principal verb preceded by more than 
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one.auxiliai^. ' Thus, "He may have been going" Is asld to contain an 



expanded phrasal verb, but ’^ He should listen ” does not (under the adopted 

t 

definition) . The Infinitive particle ^ does not figure In this count of 
words. It shouTd be added that verb forms following the principal verb 
are here not regarded as expanding the phrasal verb. Thus, ” He was 
going to write” Is not regarded as containing an expanded phrasal verb. 

itelatlng to the Items Involving adjectives, only two points need 
clariflcatlcm. First, predicate adjectives (sometimes called adjective 

. I 

f 

complements) such as brave In "The hero wSs brave. ” were not cminted 
tecause (a) trans format Icnial theory regards them as belonging to the 
elemental syntactic base of a sentence ant^ (b) children normally acquire 
their use- vei^ early. Of course, a series of predicate adjectives (as 
in "The hero^ was brave and s t rong* * Would be reported anKmg coordinations. 
Second^; it should be-^undewtood that idien> two or more adjectives stand 
before or after the nominal they modify^ the analysis sheet cells for re- 
cpirdixig thma as a single series, fiut In the total adjective count, every 
Individual adjective Involved in pre-posed and post^posed series was 
. recorded . 

Nour* adjuncts are Illustrated by summer In the construction summer 
day o^ by motor In motorcycle . 

The genltiye forms counted as modifiers are only those that precede 
the nondnal, as In his book . A later. Separate ttem provides for recording 
predicate genitives such as hls In ”lbe book is his .” 

Nominal izat Ions of verbs are Infinitives or verbals ending in -Ing. 
(often called gerunds) ^en they clearly function In ways nouns may 
function. " To fish Is fun” and " Fishing Is fun” both Illustrate such 
nomlnallzatlon. But so do "He wanted to fish” and "He liked fishing .” 
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th^ aui/ils ^4lif9 ^9^ aepatate recording of inf Inlt lyes such 

as theV In - ''i^^ ^v td fish 4 ” Id^tifylng it as a special kind of 
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Ih: a verb ^rdsd., ^ete is overlap tkenj In the Item dealli^ 
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satlOnS: Include gefhnda» but alaO because Infinitives that extend Verb 
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phrSses ei^ net #11^ ^ In "He Is going to fish« ” the Infinitive 
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: wouie be list^ es beiansiPS to the verb phrase but net as a nomlnallzatlon . 
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the i^^cl^l verb associated uith auxiliaries in 
snch- -res: aiav: go ^Or buiriit to .go ^ 

- Sentji^e 'adverblals ate here to be understood as adverbials that 
' assOciated^j^Witii a whole S eht ence:. they do not 

a parti 
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particular eleiaeht in the X^unlt. There IS sorae 
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v^7:v room for variations in judgment of what constitutes sratehce adverbials.;, 



y' 'X'.^ ■-'■-■ 

: bence» . attan be given to some particular rules applied. In this 
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aiMlysls^^ t IntrpduclPry Vords sneh as well« no» vcs* and: oh were 
IS^aiddd as Sentence adverbials* as were words like moreover and however In 
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all pOalti^S.'’ Clauses such ss X think Or you see were placed in. the 

^ ’ t ^ nate^^^ of Sent^c adverbiala >dieh they were IntrOjected within another 
7:^1 clause. $uch. ^preS8lonS re also So .labeled when they came at the ends 
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df c'laU8es:» as were tag giteStiOna like ”did he?” and ”didn*t he?" But 
y " idieh . Such ad l^resslon as "i think" was the first eleaient In a clause 
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thdt Qffer^' a ndmlnat object of th^ verbg it was naturally not Identified 
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Finally, It nay be noted that ^en t^ T-tinita were joined by a 

' ■ 'J..- '^ ' ' ■ s ^ ' 

coordinating Conjunction (ekamplea: and, but, for, and ao when It doea 

not cai^ the' aetiae of purpoae) , the^ conjunction waa regarded as 
introducing the aecohd T^nit. i^t thia l^tid of introductory expreaaion 
ia uhderatdod aa a linker, not aa a .sentence adverbial. 



^oceaaing: and Reporting the Data 






in^ this inveatigation dealt with behavior of 
children^ in nine aubgroupa defined solely by treatment tn^ and age range. 
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Further breaMtw to be feasible because membership 

<.-ih all auchVan^'beta' wc 






you Id ; have been very low; two of th^ would have been 
coa^ai^ of onryVthre.e childi^n table' 1 has identified the subgroups 
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S<kni of the, langhfl^e features n^^ in analyaea and summaries showed 



vitiations that it seemed most appropriate to report 
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yV ithei^ total. :pr<c^UCtith in ; terms of subgroup means, ranges, and standard 

‘ ^ ^ ' i' ' ' 'V * 

i davdations / for the aame reason, subgtoup means,! ranges, and standard 

. |le^ reFPtted for the percentages of all multiple'^word units 

. that r^r^^ inoc^lete.. subgroup insans of total production of both 
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, con^lete and| li^O^lete T-nnits were cpmp^ but it appeared unnecessary 
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|!6r all other tankage features fl^re In this report, beginning 
^th. item "lb on the analysis sheet, the individual and subgroup rates of 
ir?idehce per lOp it-unita were computed. The subgroup means are presented 

in three^ tables . , 

A, feW items named oh the analysis sheet,. (predicate genitives^ for example). 
Were fpund not to be represented in the corpuSL studied,; others were observed 
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to occur |6 «por%$icaIly tlMt a tat tat leal atteattoa to tti^ Is useless . 
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; ; ' ' Still p^er Iteics are not rej^rted tn the tables because their occur*^ 
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:'\f;; ' ^ xmietit- mt» itMit InVatiiatly tied to another language feature that la 
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yyy' ^epuhted fprv For exai^leg 5X of the 61 participles that modified 

nomlnals in the ianjj^a^ samples mere in the present te^se; coUSidering 
;also the sul^rOup scatter of past participles » it seemed ttlvial to 
process s tet is tically the tense, differentiationih adjectival participles. 

. . . . \ . r. . ' 

Mheh the raV data on Occurrence pf va^ous syntactic features in 

n- ^ ^ ’■.' . 'I' r - " ^ ' -S^.' ^ ^ . ' ' ' > . 

each child/ s iah^age production had been ttehSlated into percentages 
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of ^e a|Uiti^^ units they had produced.g thbse percentages constituted 
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rae inj^t fpr a 3 x 3 factprial, ahalyses Pf variance as shown in Figure 1 
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Figure 1* Experimehtai Qesic^ used to assess treatment and 
'-■' , , group- 
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^^SVbatai^es were conducted at each age group level using the simple 
: randomi^ Pf variance Ci*ind^iStg 1953, pp. 47-66) . If signifi- 
cant diLf^eren^^^^ fouUd between treatments at a particular age group 

‘ level g orthogonal comparisons Were used tp test the f Pi lowing hypotheses: 
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The Processed Bata 

Table 2 shows for subgroups of subjects the mean frequency, standard 
deviation]^ and Individual range of total occurrences of garbles, audible 
pauses, single iroards of assent or dissent, and other one-word responses. 

Tab la 3 reports subgroup means., standard deviations, and Individual 
ranges of percentages of multiple-word units that were incomplete, total 
words in mUltlple-word units, 'and mean word length of i^ltlpl e-word units. 

\ Tables' 4, 3>: and 6 all report, for treatment -age subgroups. Incidence 
Of o<^rtaih lah^ ag^ fca tu re s as tat ip s of occurrence per 100 mu 1 tip 1 e -word 
T*^ni'£s vboth complete and incomplete). These tables are closely but not 
:^actly keyed sheet. As explained earlier, some Ite^ on 
the analy^ shaet have b:^n omitted . Scmie rearrange^nt of the order of 
,;^tpi|^'';.ha;a al'sp: pr^ed. 4cslrahle> 

Table reports rates of occurrence of ten types of expression vhich, 
fbr reasons explained esrlier, are labeled "simple structures." It should 
be hoted th^t In Tabia 4, the sum of contracted negatives and negative words 
‘approxi^tes the total shown for negations in general;: implied negatives 
figure in. that tctal i but were so few in number that they were not entered 
In the tabl|. "\Sisidlarly, yes/no questions and idi-questlons make up the 
total for questions in gene 

Tsble 5, reports the. incidence of complex syntactic r^'nictures 

j^at do not ihybly full clauses. It should be noted that soma of the 
;cstegOfies sfe broj^ti down into constituents Indicated by Indentation. 

- 1 " " h 

In Table 6 are shown the mean occurrences per 100 multiple-word 
f-Unlts of various types of subordinate clauses and of the use of co- 
ordinating conjunctions to introduce T-unlts. As In Tables 4 and 5, break- 
downs of categories are Indicated by indentation in the Item list. 
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ittcidehce ic>^r Garbles Aiiidtbte. Yes/Nb Raspbn^ 

■ ;': ' ^[■,^\}]'‘r;^-'':i\ ' "/ ' 






A ^ .V -/ 



- Jr 1 ^ 

Treabnent^age 
. subgroups ;; 


: ' Garbles 

. . . 8 


Range 


^ Audible >5j|uses- 

... .'X,.-'. V 'M.: , .-'■ .'Rahae;.. 


• Yes/No 

. ites^onseb * 

X :,-a.' . 


Range 


Other one-word 
^ Response? 

X a Range 


, Ai-- 


8.70 9.52 


:d-32 


6.10 7.55 


0-25 . 


9.50 6.48 . 


0-17 


3.70 1,42 


1-16 


■- . . 


. 3,90 3 :?a 


0^9 


2.30 2.67 


P-9 

^ia 


’■■ 5,30 , 2.63 • ■ 


1-11 


3.00 2 i 62 


0>7 


''■-:; ct- /v;' 


2.89 5.51. 


0^17 


r 1,67 2.74 


0-8 


3.78 , 3.55 '. 


0-11 


4.33 3,74 


0-11 


--„;:'A2/j ■; , 


a,8T 


1''32 


* ' 4.62 6.50 . 


0-18 


6. 50 ■. 3*37 ; 


1-16 . 


6.25 6.71 


O- 2 O 


; ‘ ■ M'. ■ 

' ' "r 


8*40- 6.62 


0-18 . 


8.60 8.11 


Pi- 24 


,5:. 10; 2 . 47 ' , 


1-lP 

t . . 


2.60 2.50 


P-f 


.'-C2-: 


Hi 30 11.75 


0-37 


11,10 14.31 


0-48 .; 


8.60 7.65 * 


i - 

1-25. 


2.30 3.43 


O-lO 


,; ' A3' - 


8.78 13.49 


0>.i6 


4.89 7.28 ■ 


0-22 


5.11 5.69 


0-19 ' 


2.22 2.33 


-■ 0^6-' . 


■ 93 . 


8,56 5.46 


2-19" 


5.33 6,14 


0-20 


. 4.89 2.42 


1-9 


1.33 1.00 


0-3 ., 


G3 


iQriOO 8.29 


1-20 


. .- 3,76 4 i 4l 

* / 


0-14 


8.33 4.72 


0-16 


2.78 2 .22 


1-8 

. . ( * ■ 



'i' , ■ ' 



^;'V 









^ \ ' r 



4^. 






V 

■ ' ' '^ ' 
'. ■ ’ r.^'. 



' ' ’-^■;^ V ' ' - V - ‘ K 

s ■ ' i . ’ 1 ( .V, 

V li ■'.'*/ ^ ^ y~ ' 



; , , 









h ip urn ip n p n iww ■ i g pww^f^^^^i^^iw^^TWljW^Wiwp^lWT^WflipiPiiPIWPfl^WIWPlHIPPWPWlIPWiWiP^liWIiWiWfpWWPiliiPWM 

■ ► ■ ■ '^ » ■ ’ ■ ■ ■ L. ■. ' '^ , ' ' ' ' ' ^ ‘ ‘ .’nf. H ' ' ^ . H ■ ', ■ ■ , . ■ 




'■ 'Tabl* .4 i . ' ' ' 
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M««n lncld«nc« of $l]nplo. Strueturoft O^eurronOb por 

IDO MultipU^Word t-Vnltf 



Vorioblo 


A1 


B1 


Cl 


TrMtmmC'Ag, subgroup, 
A2 B2 ^ 02 . 


A3 


B3 


C3^ 


Nogotlonf (oil typos) 


32.04 


24.30 


41,02 


25.31 


4 

18.21 


17,01 


19,39 


13,99 


18.90 


Gontractod Mogotlvot 


17.99 


13 . 15 


25*37 


14.69 


10.08 


9,79 


11,21 


7,34 


9.61 


Negative Words 


13.59 


li.15 


14,28 


10.61 


7,84 


7,22 


8,18 


5,59 


9.29 


Elliptical Negatives 


21.63 




12.69 

t 


11,43 


5.88 


7,22 


7,88 


5,59 


8.65 


Questions (both types) 


2.59 


3.98. 


,75 


. 5,31 


4,20 


4.38 


1.21 


5,24 


3.52 


Yes/No Questions 




1.33 




2,04 


1.96 


2.06 


,91 


2.80 


.96 


Wh*^estlc^ 


2.59 


2,39 


,75 


3*27 


2.24 


2.32 


,30 


2,45 


2.56 


Elliptical (^estlons 




1,19 


,75 


2.86 


I.IZ 


.77 ] 




2.10 


1,92 


Expletive Constructions 


.95 


,29 




,63 


1,54 


.45 


,54 


1.14 


2.39 


Indirect Objects 


3.14 


,91 


.44 


2.24 


2*58 


2.66 


2.95 


3,12 


5.64 
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InpldM^ip# pf gufeclausltl C^botp^ ^tniptutpss 
. Opourrpnop ppr. iOO i^ItlpIp^Wprd \T , 



!. 



VaripbU 


A1 


Bl 


Tiraatniint^Age Subgroups 
Cl A2 B2 C2 


A3 


B3 


C3 


Non-cipuspi modifiers of nomlnpls 


28.05 


19.47 


15.70 


22.62 


30.51 


27.34 


27.36 


30.26 


35.40 


Adjectives 


6.47 


6.76 


6.72 


5.41 


li.74 


6.19 


4.38 


5:53 


4.45 


Single, pre-pQsed 


4.40 


3.35 


6.28 


4.88 


10.11 


4.92 


3.96 


3.59 


7.08 


Pre-ppsed series, of two 


.92 


1.70 


.44 = 




.93 


.38 


.16 


.28 


.30 


single, post-pos^ 


.17 






.52 


.67 


.47 






1.61 


Noun pdjuncts 


4.57 


4.19 


1.97 


3.37 


6.23 


4.33 


6.70 


4.88 . 


3.60 


Apposltlves 


2.26 


.86 


.44 


1.74 


.24 


1.34 


1.60 


1.57 


2.52 


Genitive fonM 


9.02 


5.95 


4.74 


5.83 


6.68 


7.29 


9.45 


9.83 


8.43 


Pprtlclples (nonrphtpspl) 


;77 




: .43 


1.70 


.21, 


1.16 


.36 


.80 


.95 


j^rpses 


3.75 


1.70 


1.01 


3.40 


5.64 


5.65 


2.84 


8.23 


8.58 


Preppsltlonpl 


3.12 


1.22 


1.01 


3.02 


4.58 


4.36 


1.77 


3.64 


6.62 


PartlclplPl 


.17 






.97 


.88 


1.13 


1.06 


2.23 


1.55 


Infinitives 


.46 


.47 






.18 


.16 


.53 


2.36 


/ .40 


NomlnPilsptlons of verbs 


3.20 


1.01 


3.22 


2.94 


4.21 


1 4.26 


5.32 


8.07 


4.53 


Gerunds 


1.34 




1.70 


.85 


2.12 


.99 


2.63 


1.62 


Infinitives 


1.69 


1.72 


1.51 


2.09 


4.92 


2.08 


4.32 


5.45 


2.91 


Infinitives In verbal expreselotis 


4.52 


2.35 


4.82 


4.i3 


6.31 


6.70 


4.97 


6.84 


9.73 


(excluding those associated 




















with modal auxlHarles) 




















Adverblais of Manner 


3.00 


2.16 


.79 


2.06 


.36 


2.11 


.45 


1.36 


.99 


Single words 


2.53 


458 




1.70 


.36 


.83 


.16 


.83 




Prepositional phrases 


.48 


1.57 


.79 


.36 




1.42 


.33 

I 


.53 


.99 


Sentence Adverblais 


4.12 


2.73: 


2.13 


5.23 


7.95 


6.27 


4.08 


6.74 


5.83 


Coordinated structures wljthln T -Units 


9.23 


6.49 


16.99 


6.37 


11.97 


9.83 


14.80 


19.50 


11.25 


Npmlnals 


2.46 


1.49 


1.35 


1.49 


5.14 


2.43 


2.73 


7.47 


3.66 


Adjectlvals 






.79 


.89 


.74 


.54 




1.20 




Adverblais 


2.04 


,23 


.85 / 


.36 


.46 


.31 , 


1.57 


.46 


.79 


Predicates 

* 

■ 1 ^ di « ' 


4.75 


4.78 


14.01 


3.62 


5.62 


6.54 

i 


10.86 

t , 


9.93 


6.80 

j 
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Table 6 



Mean 'Incidence of Subordinate Claueee and of T-Unlte 
Intiraduced by Coordinating Cohjunetlones 
Occurrence per 100 Hultiple*Wprd T-Unlts 



Variable 


Al 


B1 


Cl 


Treatment ^Age Subgroups 
A2 B2 C2 


A3 


B3 


C3 


Total subordinate claueee 


14.76 


11.55 


13.43 


7.75 


21.56 


16.24 


13.33 


17.82 


14.74 


Noun clauses 


6.42 


1.89 


1.44 


1.61 


6.12 


4.74 


4.38 


5.53 


4.45 


Adjective clauses 


1.73 


3.44 


1.78 


.85 


4.99 


3.08 


1.24 


1.92 


1.68 


Introduced by relative pronouns 


.54 


.91 


.44 


.21. 


1.16 


1.71 


.18 


.94 




- Without Introductory woird 


1.19 


2.98 


1.33 


.64 


3.81 


1.36 


1.07 


.98 


1.68 


Adverblel clauses 


6ai 


3.90 


5.88 


3.38 


7.23 


6.40 


8.38 


10.73 


8.74 


Time 


1.52 


.62 


2.99 




1.61 


2.37 


2.36 


2.70 


3.34 


Place 


.35 












.16 






Manner 










.36 




.33 


.40 




Cause 


3.96 


3.28 


1.66' 


3.15 


4.54 


3.64 


4.92 


6.58 


5.00 


Condition 


.29 






* '“V'* 


.63 


' .38 


.18 






Comparison 








.21 


.21 










Purpose 


I 




.43 




.33 




.18 


.79 


.40 


Result 














.18 


.26 




O^er 






.79 




.24 










T-unlts Introduced by coordinating 
















1 




conjunctions 


14.13 


14.35 


6.16 

X 


n-i8 

V 


23.85 


21.77 


28.98 


28.27 


27.28 
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Suomaries of analyses of variance in skean rstes of ^curr^ce of 
subclaussl and of clausal syntactic features are provided in Tables 7 
and 8 respectively. Tables 9» 10, and 11 present sumnaries of sub- 
analyses of variance widiin treatment subgroups at the three age levels. 

As e^Tsined earlier, the items involved in these subanalyses are only 

' - _ ^ ■ ■ 

those for Which the probability value st some point in. Tables 7 and 8 



was found to be at the .10 level or better. 

" " "" * ^ 

Interpretations 



- It l^.,alrOady been noted that vide age ranges within the subgroups 



of subjects of this study may cQs^licate interpretation of the language 



analysis that has been performed. There are other pertinent variables on 
Which infonsation has not been available. The IQ factor, on Which the sub- 
groups Of children may differ remarkably, cannot here be taken into account. 
No inf oration is at hand, either, on variations in home environment. Which 
may significantly condition language behavior. Such variables as these may 
quite possibly explain to some degree the differences observed in comparisons 
of subgroups^ sS small as those invol>^ in this investigation. 

Another limitation to bo in mind is that the language corpus 



stodied here was collected under a special selt of conditions. Those condi- 
tions have been described earlier in this report. They were such as to 

' 1 - * 

call for verbalizations dependent on both the children's perceptions as ^ 
they viewed films imd on their memory of What they had seen. The presence 
of tape recover and microphone may also have affected some of the children 
as distractions or inhibitors. Transcriptions of interviews, particularly 
those with the youngest subjects, rsther f^quently included interviewers* 
explanations and assurances relsting to the recording equipment, as well 
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table 7 



Meaii Total Wordage riii Multlple^Wcrd T-Unlts, Mean Length of Such Units, 
an3 Mean Rates of Use of Subclausal Synt^actlc Stractures Per 
IQQ Mu It Ip ih -Word t -Unit's; Sunima^ of ^alySes of 
Variance for Age and T^atment Groups. 



*^Slgnlf leant at the .05 



level- 

level. 
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. Aae Groups 


Treatimeht Gfbups 


Age X Treatment 


Error Within 


Variable 


Mean S'q. 

(df « 2V 


F 


Mean Sq. 
(df « 2) 


F 


Mean Sq. 
(df - 4> 


F 


Mean Square 
(df « 75> 


Mean total wordage- 


56725.26 


3.68** 


1242.56 


.08 


22107.33 


1.43 


15403.33 


Mean length of T-unlts 


10.83 


.28 


. 40.02 


1.03 


21.85 


.56 ' 


38.78 


Expletive cats. 


6.23 


1.67 


.65 


.17 


6.50 


1.74 


3.73 


Indirect objects 
Non-clausai modifiers 


40.69 


3.52** 


4.00 


.34 

1 


18.45 


1.60 


11.56 


of nominal s 


692.^8 


2.65* 


4.33 


.02 


334.10 


1.28 


261.38 


Adjectives 


8.97 


.16 


41.62 


.74 


106.14 


1.89 


56.15 


Noun adjuncts 


16.25 


.71 


26.96 


1.18 , 


16.85 


.74 


22.86 


Apposltlves 


5.27 


1.03 


6.64 


1.30 


5.00 


.98 


5.11 


Genitive forms 


65.11 


1.30 


11.44 


.23 


21.85 


.43 


50.15 


Participles 


2.72 


.74 


2.99 


.82 


2.29 


.63 


3.65 


Phrases 


139.61 


6.27** 


23.94 


' 1.07 


49.70 


2.23* 


22.27 


Prepositional 


45.60 


3.75** 


13.15 


1.08™*"> 


30.81 


2.53** 


12.17 


Participial 


17.18 


4.67** 


.64 


.17 


1.39 


.38 


3.68 


Infinitive 


7.51 


3.10** 


5.32 


2.19 


3.29 


1.36 


2.42 


Nominal Iz at Ions of verbs 


86.88 


2.58* 


2.74 


.08 


24.61 


.73 


33.62 


Gerunds ' 


5.16 


.60 


6.85 
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8.76 


1.02 


8.54 


Infinitives 

Infinitive complements of 


46.74 


2.15 


25.66 


1.18 
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7.19 
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21.69 


non modal verbs 
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49.04 


1.77 


19.57 


.71 


27.70 


Adverblals of manner 
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1.13 
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.1.47 
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Single words 
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2.41* 
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Preposition phrases 


1.09 
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1.13 


2.94 


i.02 


2.87 


Sentence adverblals 
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1.78 
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.27 


15.22 


.30 


' 51.05 


Coordinations 


251.06 


1.36 
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.32 


224.26 


1.22 


184.24 


Momltials 


57.05 


4.38** 
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Adjectlvals 
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2.91 


1.10 
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Adverblals 
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1.59 
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4.07 


Predicates 
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. Table 10 



: ^bahalyses of Variance: in Rate of Use of Selected 
Syntactic Structures for Treatment Subgroups . 

of Age Group 2 



t 

» Mean Squares 

Variable l:4f « 2V 


F ^ 


Error Within Subgroups 
Mean Squares 
fdf « 25^ 


Total word A in multiple* 






— 


word units 


^246.51 


1.80 


18992.15 


Meaii lex^th) of -units 


50.27 


1.28 


39.27 


Indirect: Objects 


.42 


,03 


13.30 


Nonrciausal. modifiers of 








nomihais^ * 


138. SK) 


.64 


; 216.08 

* 22.85 


';i^ra8e8' 


7.77 


.34 


Prepositional 


6.i4 


.36 


16.94 

i* 


participial 


.16. 


.05 


3.31 


In^lnltiye 


.08 


.40 > 


.20 


Npinihalizatlons of verbs 
Inf inltiye c<niiplment8 of 


4.58 


.19 


24.48 


hoh>4S:^ei: yefbS' 
Singie*wOrd adverblals of 


I6:^53t 


.48 


34.20 




5.43 


2.82* 


1.92 


(k^rdinatlons. of nomlnals 


33.41 


2.44* 


13.68 


Noiih clauses 


46.34 


1.66 


27.80 


A^yerbiai ClSuses 


35.32 


.98 


36.12 


Cause 


4.57 


.25 


18.08: 


Coordinations of T^ntts 


I8i47 


.07 


270.86 



^Slghificant at< rhe ^10 level. 
. iM^Slgnlf leant at the .05 level> 
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Subanalyses of Variance in Rate of Use of Selected 
Syntactic Stiructures for Treatment Subgroups 

of Age Group 3 



Variable 


Kean Squares 
(df = 2) 


F 


Error Within Subgroups 
Mean Squares 
(df ** 24) 


Tbt^l words in multiple- 
wbi^d units 


1964.75 


.16 


11998.55 


Mean length of T-units 


.38 


.17 


2.17 


Indirect objects 


20.51 


1.19 ; 


17.17 


6on -clausal modifiers of 
nominal s 


149.15 


f 

* 

.57 ' ■ 


260.07 


Phrases 


93.05. 


2.70* 


34.43 


Prepositional 


53.86 


4.58** 


11.77 


Participial 


3.09 


.39 


7.94 


Infinitive 


10.80 


1.76 


6.14 


Kominalizativns of verbs 


30.98 


.58. 


53.27 


Infinitive compl^ents of 
non -modal verbs 


51.82 


2.76* 


18.80 


S ingle -^rd adverbial s of 
manner 


1.75 


1.74 


1.01 


Coordinations of nOminals 


56.90 


3.71** 


15.32 


Noun clauses 


3.72 


.13 


28.54 


Adverbial Clauses 


14.47 


.29 


49.55 


Cause 


7.91 


.32 


24.83 


Cbprdituitions of T-units 


li.81 


.02 


571.15 



^Significant at the .10 level. 
^Significant at the .05 level. 
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as requests that the children **speak tip*' or that they should not just nod 
or shake their heads. One advantage of the research procedure adopted 
was that It provided a uniform stimulus for the language behavior to be 
studied; there is, therefore, a common basis for comparisons. The language 
samples obtained, however, do not necessarily show ^at the children's 
speech may be under other stimulus conditions. 

It must be recognised, too, that this study does not deal with all 
the aspects of language that miglit be of interest. It did not assess 

vocabularies, it did not report on articulation or other aspects of 

' 

pronunciation, and it did not concern itself with grammatical forms of 

I 

Words or .matters that are traditionally referred to as problems of usage. 
Though it recorded certain features of language behavior that simply reflect 
fluency, it focused attention on the children's syntax. Even in this airea^ 
of course, the intent was not to produce an eidiaustive analysis but to 
attend tp features most likely to indicate the children's degree oif 
control of the syntactic resources of their language. 

Fluency 

Linguistic fluency is obviously impeded by indulgence in audible 
pauses and syntactic garbles. The relation between such indulgence and 
other aspects of language control, however, is by no means clear. Little 
study has been given to children's audible pauses, but Riling (1965) has 
noted that among 4th and 6th graders ^pm she studied, the incidence of 
garbles seemed an unreliable index to general maturity in their use of 
language. O'Donnell, Griffin, and Norris (1967) observed, in their report 
on the language of children in Tennessee that, under comparable conditions, 
7th graders produced almost as many garbles as kindergarten children, and 
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that 2nd and 3rd graders produced a great many more. They reported 
extremely wide divergences between individuals at each of the six age- 
grade levels they studied,, and concluded it was impossible to draw from 
group data, oh garbles any very useful generalizations . ^ 

The present study supports the findings of Riling and the Tennessee 
investigators. Table 1 shows the same kind of wide individual variation 
in production of garbles observed by O'Donnell, Griffin, and Norris, and 
it appears to reveal no meaningful pattern in the group means. The 
individual summaries from which Table 1 is drawn, moreover, show that 
high frequency of garbles characterized some of 'the otherwise most compel 
iterit speakers. ?or example, more than one third of the garbles recorded 
for Subgroup A1 were p'roduCed by the boy who on almost every other count 
demonstrated; linguistic superiority over the other children in the group. 

1%e i^de individual divergences in production of audible pauses and 
the scattef iri subgroup me^hs of their occurrences suggest that they too 
have little sighificahce in the differentiation of subgroups. Of both 
garbles and audible pauses it can probably be said that though a few of 
the children indulged iti them excessively, their total production was 
normal for a grOup of 84 preschoolers. 

ih® high frequency of single-word expressions of assent or dissent 
and the incidence of other one-word responses, reported in Table 1, 
reflect inore clearly a cc^on lack of fluency in the language behavior 

studied here. These responses were generated by persistent questioning 

_ 

and cueing of the interviewers. The behavior of interviewers probably 
was, in most instances, reaction to the children's reluctance to talk 
about what they had seen. When it is observed that one-word responses 
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were generally most frequent In the two younger age groups (with the 
notable exceptions of Subgroups B2 and C3)^, this assumption leads to 
the query of vliether the stimulus situation exploited In this Investi- 
gation Is appropriate for children much below six years of age. It Is 
also possible^ however^ that the particular children studied here have 
-not had sufficient benefit from situations In vdilch they have been 
encouraged to talk freely about \diat they have seen. Perhaps their 
training should Involve more opportunities of the sort presented to them 
in this assessment effort < 

The, Incidence of one-word responses does not consistently dif- 

i 

i 

ferentiate subgroups of chlldr^ given varied Interventional treatment. 

However^ Table 2 shows that In the tw> older age groups single-word 
responses of assent or dissent most frequently occurred among children 
^o had had Treatment C. 'In the lowest age range such responses were 
most frequent in Subgroup Al^ but a large share of them is attributable 
to two Individuals. 

A high rate of production of grammatically incomplete T-units may ^ 

also be reasonably taken to Indicate lack of fluency. In this study ^ 
computation of Incidence of Incomplete T -units excluded one -word responses. 

Table 3 reports the percentage of multiple-worO units (those consisting of 
two or more words) that were syntactically incomplete. Inspection of that 
table ^ shows that the lowest ratios of Inconplete T-units were found in 
the speech of Subgroups Al« A3^ B2^ and B3^ vdiile the highest ratio was 
that of Subgroup Cl. These facts may suggest treatment effect « but the 
great individual variation within subgroups dictates caution in offering 
this interpretation. The generally high ratio of incomplete T-units in the 

o 

me 



speech of the Vest Virginia children is indicated by the fact that 
only 9.90 per cent of T>uiilts produced under similar stimulus conditions 
by kindergarten children in Tennessee were gransnatlcally incomplete 
"(O'ppnnell,; Griff iUj, and !Jorris-1967, p. 76). 

Xudugh word production (volubility) may be distinguished from fluency, 
it will here be discussed under this heading. In this study, computation 
of total wordage excluded pne-word; responses, following the practice of 
the investigation reported by O'Donnell, Griffin, and Norris (1967).* 

The subgroup n^ans of total words in multiple-word units shown in Table 3 
may be compared with the mean wordage of 209.4 in speech production of 
Tennessee kinde^arten children (O'pormell, Griffin, and Norrls~1967, p. 43) 
It must be remembered, however, that West Virginia interviewers, unlike 
thbse.'luiVolvedi-ln^ the-vTennessce -studyy usually led their children 
persistently through a lo^ series of questions and cues. 

It is possible that tf eatnient effect is shorn in the youngest age 
group by the notably greater word production of children who had been 
subjected to TTOatment A, though no general variance in this respect 
mmg the three types of treatment waS' statistically significant. The 

\ u ^ 

p^est mean wordage is found in the speech of Subgroup Cl. It is to be 
expected that older children are the mpi% voluble, as they generally proved 
to be in this study, thou^; the mean for Subgroup A2 is lower than that 
for Subgroup Al.. The total word production of the oldest age group 
was higher than that of either of the other two, and the difference is 
significant at the .10 level. 
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Syntactic Control: 

T-unit Length; Coordination of T*units 

In discussing word-Iength of T*unlts In the West-Virginia language 
samples » it should be kept In mind that both complete and incomplete units 
are Involved^ but that one-word responses are excluded. 

l^nt (1965) and 0 'Donnelly Griffin^ and Norris (1967) have shown 
that mean length of T-unlts Is a good measure of children's relative 
maturity in syntactic control. Inspection of Table 3 will show, however, 
that it does not very sharply differentiate subgroups involved In this 
study. In the youngest age group. It is true, bpth subgroup means and 

- ^ M 

(■' 

ranges of individual means indicate distinct superiority in Subgroup Al. 

(The fig^jre of 9.00 In the Cl range should be disregarded, for 

I 

It was the single complete T-unit produced by one of the children.) On 
the other hand, the mean of Subgroup A2 was the lowest among those of the 
middle age group, and means in the. oldest age group are uniform. A possible 
conclusion suggested by these data is that Treatment A had a superior 
developmental effect on very young children but, in the respect considered 
here,' at least. It did not distinguish Itself when applied to older 
children. The evidence for such a conclusion, however. Is not s tat is- 
tlcally significant. 

One reason for using the T-unlt rather than the "sentence" as the 
basic unit of measurement in the study of children's language is that, as 
Bmt (1965) has demonstrated, young children characteristically lengthen 
their sentences by excessive coordination of Independent clauses, and the 
least competent are likely to Indulge in the practice most frequently. 

The percentages of independent clauses introduced by coordinating con* 
junctions in the language samples studied here are shown as the last Item 
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in Tsbi e 6 . Little general importance can be attacked to information to 

be f(wnd there. The hig^. percentage for Subgroup ^ is largely accounted 

. . . <> ' 

f by tvo children. All the subgroup percentages are lov in con^arison 
to that of Te^essee kindergarten chiidren studied by O’Donnell, Griffin, 
and Norris : (1.967) , but that is. p^robably explained by the fact that the 
West Virginia children much le^s frequently produced uninterrupted 
i;^rratiye accounts of vhat they had seen. It will be noted that the 
youngest age group studii^ here us^ the fewest coordinations of T-units^ 
but this fact' is in lino with the evidence of the Tennessee investigators. 

' M - - tf 

that children tend to increase use of such coordination with advances 
iu age, up through the fifth grade:^ 

- . . ... V 

Syntactic Control;, Simple Structures 

Not unexpectedly 9 the children studied showed themselves perfectly 
capable of using both iiegative words and negative contractions, though 
their implied negstiohs (as in **I doubt it” or **He cquld hardly see”) 
were sp few that they have not been eUtered in Table 4. The high 
f regency of eHipticdl negations' contributes to the accumulation of 
Pne-wOrd responses that has been noted as. evidence of lack of fluency. 
Hany Other negatives vete also keyed to interviewers’ questions aiid 
positive urgihgs. Any differences between subgroups in Use of negations 
is probably accoimted for by interviewers* behavior. 

Little coti be said about the incidence of questions except that 
it was somewhat higgler in the two older age groups, ^en here, there 
is the exception of Subgroup A3. Probably no significance is to be 
attached to this item, except that the record shows (as could be expected) 
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Chat all subgroups were capable of questioning. The common stimulus 
conditions were not such as to make questions uniformly appropriate. 

Those conditions, however, might well have elicited frequent ex- 
pletive expressions (such as "There was an ant"). The low incidence of 
es^Xetlvcs may reflect undeveloped language performance in Che children 
generally; no subgroups markedly distinguished themselves in use of them. 
Chough subgroup C3 produced them most frequently. Neither Age Group nor 
Treatment Group variances were statistically significant. 

Indirect objects identify Che simple structure Chat most clearly 

differentiates subgroups within two of Che age rknges. Subgroup A1 used 

* 

indirect objects notably more often than did other children in Che 

^ ^ 

youngest age group, and Che difference was significant at Che .10 level. 
Among Che oldest children. Subgroup C3 was nonslgniflcanCly distinguished 
by its more frecpienC use of Che structure. If use of indirect objects is 
a sign of relative maturity in language production, and if Che performance 
of Subgroup A1 is, at this point, attributable Co Che educational Inter- 
vention, it can be said once more Chat the "package treatment" may be 
■distinctly effective with the youngest children but not with Che older 
ones . , 

It should be noted Chat passive constructions, introductory adverbials 
with inverted subjects, and expanded phrasal verbs occurred so infrequently 
in Che language samples that records of them were not enCere-1 in Che Cables. 
The first and third of these three constructions might well have been 
^pecCed more frequently in language of subjects in Che age ranges 
represented. The construction involving subject inversion is probably 
not Co be so expected. 



Syntactic Control; Subclausal Complex Structures 

The study of children's syntax report^ by O'Donnell, Griffin, and 

Norris (1967) concluded that in lan^age produced under closely comparable 

stimulus conditions relative incidence of subclausal complex structures 

such as those reported in Table 5 is an excellent Index to the degree of 

syntactic control possessed by children. That study (pp* 56*70) reports 

for many of the structures dealt with here the occurrences per 100 

Trunlts in the language production of Tennessee children at six age 

grade levels. Though the categories employed in the two Investigations 
■ 

are not equivalent in datail, comparisons of their findings are possible. 
Speaking generally, it can be said the oldest children in West 

V 

Virginia used subclausal complex structures at about the same rube as 
klnderga-r ten^child ren' did' in Tennessee . 1 1 should- be emphasized that . 

this generalization is a broad one based on scanning of tables, not on 
painstaking study of details. - 

In discussion of subgroup comparisons in rates of use of hon*clausal 
complex structures by subjects of the present study. Table 5 scores 

separated by less than one full percentage point will be disregarded. 

^ * 

yi^er this condition, attention will be given to items on ^ich subgroups 
within the three age ranges made the highest and lowest scores. 

In the youngest age range, most of the differences in rates of Ltse 
to be noted favor Subgroup Al. On no recorded item did it have a lowest 
score, and it achieved the highest rates of use of non*clausal modifiers 
of nominals in general, of appositives, of genitive forms modifying 
nominals, of phrases in general that modify nominals and particularly 
of prepositional phrases performing that function, of single-word adverbials 
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of manner, and of sentence adverblals. Highest rates of use were 
recorded for Subgroup Cl on use of single pre~posed adjectives, 
total coordinations within T-units, and coordinations of predicates, 
but this subgroup had the lowest of the three scores on seven items 
listed in Table 5. Subgroup Bl had a highest score only in rate of 
use of prepositional phrases as adverblals of manner, but it had 
lowest scores on four items . Though variance among treatment sub- 
groups In use of subclausal complex structures nowhere attained 
statistical significance, the summaries of small; differences, may 

i 

possibly support a suggestion that Treatment A was developmental in 
the youngest age group. , 

In the middle age range, however. Subgroup A2 at no point dis* 
tlnguished Itself by highest rates of use \dien differences of less than 
one full percentage point are left out of account. On eight items its 
records were the lowest among those of the three subgroups. Subgroup B2 
had lowest scores on three Items. It had the highest scores, however. In 
total use of non*clausal modifiers of nominals, in use of adjectives 
generally and of single pre-posed adjectives in particular. In use of 
noun adjuncts, in use of infinitives as nominals, in use of sentence 
adverblals. In general use of coordinated structures within T*units and 
use of coordinated nominals in particular. Its rate of use of single* 
word adverblals of manner was considerably lower than that of Subgroup A2. 
Subgroup C2 led the other subgroups In Its age range in rate of use of 
gerunds and of prepositional phrases functioning as adverblals cf manner; 
It had no lowest scores. Differences between subgroups in the middle age 



range do not dictate any very clear, consistent interpretation. All in 
all, however. Subgroup B2 appears to have demonstrated someidiat greater 
syntactic control than did the other subgroups. 

The evidence on use of subclausal syntactic resources in the 
highest age range is also mixed. It appears, however, generally to 

f 

favor Subgroup B3 and to speak least well of the syntactic control of 
Subgroup A3 . ^ ' ' ~ 

Subgroup A3 had the highest rate of use only of coordinated predicates 
It had lowest scores on six items identified in Table 5. Its rate of use 
of adjectival phrases in general and of adjectival prepositional phrases 
in- particular was, at the .05 level of confidence, significantly lower 
than that of the other two subgroups considered together. At the .10 
level, its rate of use of coordinated ncminals was significantly lower 
than the mean rate of the other two subgroups. 

Subgroup B3 had higgles t scores in. rates of use of adjectives in 
general, of Infinitive modifiers of n^inals, of nominal izat ions of 
verbs in general. and of both gerunds and ncmiinal infinitives, of co~ 
ordinations within T -units in general and of coordinated nominal s and 
a4jectivals in particular. Its ru^c of use of coordinated nominals was 
significantly higgler than that of either of the other two subgroups, 
at the .C5 level of confidence. ' 

Lowest scores on five items entered in Table 5 were recorded for 
Subgroup C3. It had highest scores in general use of non-clausal 
modifiers of nominals, of single pre-posed and post-posed adjectives, 
of adjectival prepositional phrases, and of infinitives in verbal 
expressions. It has already been noted that rates of use of adjectival 



prepositional phrases and of infinitives in verbal expressions by 

^ * 
Subgroup C3 was, at the .05 level of confidence,, significantly higher 

than those of Subgroup A3. 

It could properly be said that comparisons between subgroups ought 
to take account of the relative importance of the various items listed 

t 

in table 5.. Selecting the entries that are most significant, a suTomary 
of highest and lowest scores within the three age r^ges may be given 
in tabular form, still disregarding differences of less than one full 



percentage point. 


Age Group 1 


Age Group 2 


Age Group 3 




Highest 


Lowest 


Highest 


Lowest 


Highest 


Lowest 


Non-clausal modifiers 
of nominals 


A1 


Cl 


B2 


A2 


C3 


A3 


Nominaiizations of verbs 


— 


B1 


.i- 


A2 


B3 


— 


Adverbials of manner 




Cl 


-- 


B2 


— 




Coordinated structures 
within T-units 


Cl 


B1 


B2 


A2 


C3 


- B3 



This summary does not obviously require any change in the interpretative 

generalizations that have been offered earlier, but it points up the lack 

X, 

of clarity in the picture presented by the evidence. 

Syntactic Control: Subordinate Clauses 

Investigators of children's language have traditionally asserted that 
increasing use of subordinate clauses marks advances in language control. 
There appears to be no reason to doubt this general notion. But O'Donnell, 
Griffin, and Norris (1967) have presented evidence indicating that (1) fre- 
quency of subordinate clauses in children's speech is not so clear a 
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reflection of relative maturity in language control as are uses of such 
syntactic features as those reported on here in Table 5, and (2) among 
the three possible types, adjective clauses are probably not dependable 

indicators , ' ' 

/ 

These (pialifications may be kept in mind when interpreting the record 

of production of subordinate clauses found in Table 6. In the discussion 

* 

at this pointy no attention will be given to the differentiation of 
adjective clauses on the basis whether or not they are introduced by a 
relative pronoun. As in the previous section, subgroup differences in 

t ^ * 

rate scores will be ignored if they amount to less than one full per* 
centage poiht. 

Ai0ng the youngest children the general rate of production of 
subord'lnate.^clauses'^was ihighest for Subgroup AI. This subgroup also had, 
at the .05 level of confidence^ a significantly higher rate of use of 
noun clauses than the other two subgroups had. It had no lowest scores. 
Subgroup B1 produced the highest score for adjective clauses and the 
lowest for total production of subordinate clauses and for rate of use 

of adverbial clauses. Subgroup Cl had the highest score for adverbial 

% 

V 

clauses relating to time and the lowest for those expressing cause. 

t 

The data may suggest that least maturity in production of subordinate 
clavfses was demonstrated by Subgroup B1 and that Subgroup Al was someidiat 
superior to Cl. 

In the middle age range, though none of the differences attained 
■ / 
statistical signific^ce. Subgroup B2 was clearly the most prolific 

producer of subordinate clauses of all three general types and Subgroup A2 

the least. Tt is possibly worth noting, too, that Subgroup B2 used the 

widest range of kinds of adverbial clauses. 



Among Che oldest children there were no statistically significant 
differences, either, ^e greatest production of total subordinate 
clauses, of noun clauses and of adverbial clauses, however was Chat 
recoded for Subgroup B3. The other subgroups match each other fairly 
closely, except that Che C3 range of kinds of adverbial clauses was 



narrower than that of A3, which in this respect was similar to B3. 

It would be interesting Co know \diy Treatment B is so consistently 
associated with high rates of use of subordinate clauses in both of Che 
two older age> groups. Subgroups B2 and B3 used both noun clauses and 



adverbial clauses with relatively greater frequency than did the kinder- 

[ 

I 

garten. chiTdren studied by O’Donnell, Griffin, and Norris (1967). For 
^rppses of comparison, it may be useful here Co note that Che Tennessee 
kindergarten children used noun clavises at the mean rate of 5.57 per 
iOO T-units, while their mean rate for adjectival clauses was 4.77 and 
.Chat for adverbial clauses; was 6.07. In production of nominal and 



adjecCival clauses, the overall means for West Virginia children in Che 
older age g^ovtps. wOuld pirobably approximate Chose of Che Tennessee 
chjytdren. The hi^er frequency of adverbial clauses in Che language 
smples from West Vi^jginia is probably accounted for by a large number 
of ques tions asked by inte^iewers . 



Summary bt interpretations 

1^ The language samples studied obviously reflected a lack of 
fiuMcy in the children who produced them. The method used 
in this investigation for eliciting language behavior may 
not be appropriate for the youngest children involved. It 
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is also possible that the children need more encouragement 
to talk freely about perceptual experiences and about the 
meanings of such experiences. 

2 . Individual subjects of this investigation showed extremely 
wide variations in behavior within every subgroup. 

3. Comparisons with the report on language of Tennessee kinder ** 
garten children by 0*Donnell, Griffin, and Norris (1967) 
indicate that, under the urging of interviewers, the older 

subjects of this study (taken as a whole) generally ex- 

\ " * 

, ^ t 

ploited the syntactic resources of the language at least 

I 

as proficiently as the Tennessee children did under fairly 
similar conditions. ' ^ 

4 . At numerous points the results of this study show in the 
youngest age group an association of Treatment A with 
l^guage behavior assumed to be superior to that demon- 
strated by children in the other subgroups in the same 
age bracket. The differences are small; most of them are 
not statistically significant. But the accumulation of 
small' bits of evidence is impressive. 

5. There is in the data developed in this investigation 
little or no evidence that Treatment A produced superior 
results in the two older age groups. Indeed, in the 
relative frequency of use of subordinate clauses. Sub- 
group A2 was least mature. 

6. In production of subordinate clauses by the two older 
age groups, there is an interesting association between 
high frequency and Treatment B. 
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7. Aside from production of* subordinate clauses, there is 
little in the data deveJ^oped in this study that dif* 
ferentiates treatment effect in the two older age groups. 

8. Overall, most of the subgroup differences in means are quite 

small; analysis of variance shows few of them to be statis* 

/ 

tically significant. 
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Appendix A 



Children interviewed but not represented in this report: 

^ Susan Vorhman, Subgroup A1 (not found oti tapes) 
Myra Lynn Jones, Subgroup AS (not found on tapes) 
Charles Houchins, Subgroup B5 (unintelligible) 



Membership of t:he subgroups: 

A1 B1 



Cl 



Valerie Dalton 
Gloria Hall 
Dawn Ellen Harvey 
Kathy Ann Vance 
Pamela Vright 
Patrick Campbell 
Jeff Clay 
John Martin Davis 
Bryan ^if fe 
Aaron Sydenstricker 



Debo'ra B*. Alderson 
Susan Header 
Wendy Price 
Teresa Wills 
Sarah Harmen 
Beth McQuillen 
Phillip Bailey 
Jeffrey Crawford 
Randy Fix 

Dexter Johnson '■ 



Doug Butler 
Tony Cline , . 
Travis -Hatheny 
James T*. Shrewsberry 
Aleisa Bailey 
Lesa. Carter 
Stacia Liss 
Debora Matheny 
T^nmy Saettler 



A2 



B2 



C2 



Kimberly 0»Dell 
Sherri Sloan 
Teresa D. Wickline 
Johnny George 
Mark Hill 
James Huey 
Tommy Smith 
David Wall 

\ 

■ 

A3 , 

Rhonda Clay 
Wanda Clay 
Bobbi Hazelwood 
Lavema Lewis 
Jipny Dalton 
Dwight Newsome 
Thurston Connard 
Mark Deeds 
.Stevie Stack 



Stephanie Ann Jones 
Debbie Header 
Connie J. HCQuillen 
Terri price 
Rhonda Wade 
Mark Brock 
John Lee Jenkins 
Eddie Hill 
Homer' Lilly 
Jeffrey Meadows 

■ B3 

Katherine L. Bailey 
Lynn Amy Barry 
^ta Houchins 
Joni Rooks tool 
Susan Wykle 
Danny Houchins 
Hark Allen. Kincaid 
Hichael Lilly 
Scott Edward Thompson 



Bill Bailey 

■Anthonv Lambert 
* 

Dean Meadows 
Arnold K, Murdock 
Jonathan Shepherd 
Robin R. Barely 
.Tawne Jo Lucas 
Roni lusk 
Kimberly Martin 
Neva Warren 

C3 

Linda G. Clay 
Barbara Cline 
Dam Liss 
Timothy Bazzie 
Freddy Cline 
Kevin Bailey 
Michael Hatheny 
Timothy Matheny 
Richard Radford ' 





* 



N'ame_ 

14,5 
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Appendix B 

APPALACHIA Educational LABCHATORY— Linguistic Analysis Worksheet 

1 T reatment Group 2,3 Code No. in Group 

T-unit No. 



_Age (in mos.) 



Hale 



The Ant and the Dovt 



8,9 



Female 



The North Wind and the Sun 



T-UNIT: 

10,11 



Words in 



12 



T-unit Complete 



T-unit 

SIMP1£ STEUCTURES 
16 Negations 



T-unit Incomplete 



17 

18' 



jContracted negatives 



19 



Negative words 

Implied negations 

20 Elliptical negations 



121 



22 

23 



J^estions 

Yes/No questions 



24 



_Wh -questions 
Elliptical questions 



^25^ 

26_ 

;27_ 

28 



Passive Constructions 



_Expletive Constructions 



_Indirect Objects 



_Intro. Adverbials with 
inverted subject 



29 



Expanded Phrasal Verbs 



COMPLEX STEUCTURES 
^30,31 Non-Clausal Modifiers 



32 



33 



of Nominals 

_Adjectives (excl. pred. adj.) 
Single, pre-posed 



34 



Pre-posed series of two 



35 

36' 

37' 

38' 



_Pre-posed series of three or more 



Sing le , pos t -posed 



Post-posed series of two 



Post-posed series of three or more 



39, 

40, 
41 



_Noun adjuncts 



Appositlves 



Genitive forms 



42 



43 

44' 



_Partlclples (non -phrasal) 
_Present participles 



_Past participles 



45_ 

46 



Adverbs 



47 

48' 



JPhrases 

Prepositional 



49 



Participial 

Present 



50 



Past 



51 



Infinitive 



er|c 



W/lliffililRlffTlTliiiJ 






13 



52 



55 



56 



59. 

60_ 

61 



80 



85 



Garbles 



14,15 



Audible 



Pauses 



53 

54 



_Nominallzatlons of Verbs 
Gerunds (incl. gerund phrases) 



Infinitives (with and without to) 



^Infinitives (with or without to) in ^ 



Verb Phrases, excluding those 
Associated with Modal Auxiliaries 



57 

58 



_Adverbials of Manner 
^Single words 



Prepositional phrases 



Sentence Adverbials 



Predicate Genitives 



62 



^Subordinate Clauses 

Noun Clauses 

With intro, words-not direct 



63_ 

64, 

65 



discourse 

Without intro, words-not 
direct discourse 
JOirect discourse that is 
tagged 



66 



67, 

68 

69 



Adjective Clauses 
Introduced by relative 



pronoun 

Introduced by relative 
adverb 



Without introductory word 



70 



71 

72 



Adverbial Clauses 
Time 



Place 



73 

74" 

75“ 

76 " 

77 ~ 



Manner 



Cause 



Condition 

Comparison 



78 

79 ' 



Purpose 

Result 



Other; 



8i 



jCoordinated Structures within T-unit 
Nominals 



82 

83' 

84' 



Adj ectlvals 



Adverbials 



Predicates 



Independent clauses joined by con j . 



86. Analyst 



APPENDIX F 



Detailed Analysis of Cognitive Growth of ECE Preschool Children 

This analysis is ccmposed of three sections* The first section includes 
the Curriculxjm Specific Test, Part Two (composed of 61 items) as the criterion 
and intelligence as a control variable. The second section includes the 
Curriculxjm Specific* Test, Part Two as the criterion and the ITPA, the Frostig, 
and the PPVT’ Pretest scores as covariates. The third section is descriptive 
in nature depicting how the four groups performed in terms of percentage of 
objectives achieved. 

Analysis of the Al. /, Curriculum Specific Test, Part Two . For this ancilysis 
AEL Curriculxjm Specific Test, Part Two, post-test scores were used as the 
dependent. varia] 3 le with Peabody Picture Vocabulary Test (PPVT) pre-test raw 
scores used as the control variable. The correlation between the AEL 
Curriculum ^ecific. Part Two, test and the PPVT pre-test raw score was 0.54. 

The hypothesis advanced prior to the analysis was: 

1. The daily thirty minute television program, weekly visit 
to the home by paraprofessionals , and a weekly visit by 
a mobile van had linear effects on cognitive development 
of 3, 4, and 5 year old Appalachian children. 

Sampling was incidental — data gathered under an earlier and different 
sampling plan were used. Subjects available with equal PPVT pretest raw 
scores were used. It was assumed all other variables were randomly distributed 
across all groups. 

The sampling distribution was the standard error of difference between 
correlated means, and the statistical model was the t-test for correlated means.. 

Six separate analyses were conducted — four groups, each matched with 
every other — yielded six separate group pairs. This approach was selected 
since it was impossible to match on the PPVT test across all four groups 
simultaneously, but it was possible to match two groups at a time. The four 



2 



,-so.parafc<^ groups were tl) those S*s receiving a daily thirty minute television 
[irogram, a weekly thirty minute visit by paraprofessionals, cuid a we^ly two 
hour visit by a mobile prefechool classroom, (2) those S*s receiving a thirty 



/minute teleVd si on lessoi^and a weekly thirty minute vis't by parapEofessiori^s 



(3) those S^s receiving a daily thirty minute television lesson, cUid those 
S * s receiving none of the elements . 

The first cuialysis compared a group receiving all three elements — 
television, paraprofessionals, cUid mobile Vcui — of the program with a group 

i 

receiving two elements — television euid paraprofessional. The ntunber in each 
group for this analysis was ten. The mecui cUid stcuidard deviation of t:he 
former group were 40,9 and 8,83, and for the latter they were 46,4 anl 4 , 84 . 
The *'t** value was -.72. Since the direction of the differences was opposite 
to that predicted the null hypothesis of no difference between the two groups 
was accepted^ Table I presents these data. 

The second cUialysis compared a group receiving ^1 three elements — 
television, paraprofessional, cUid mobile VcUi — with a group receiving only 
the television element. The number in each group for this cuialysis was ten. 
The mecUi cuid st^dard deviation for the former were 41.6 cuid 7.06, cuid for 
the latter they were 36,2 eUid 11.28. The *'t” value was +2.024, significcuit 
beyond the ,01 level. The null hypothesis was rejected eUid the alternate 
hypothesis that S*s receiving all three elements learned more than S*s 
receiving only the television eluent. T^d>le II presents these data. 

The third cuialysis compared a group receiving all three elements — 
television, paraprofessional, cuid mobile vcUi — with a group receiving none 
of the program elements. The number in each group was eleven. The mean 
eUid standard deviation for the former group were 37,37 eUid 11.62, and for 
the latter group they were 37,18 eUid 12.13. The ”t” value was +0,05, not 
significcuit. The null hypothesis of no difference was accepted. Table III 
presents these data. 
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